Wykres commitów

19 Commity (main)

Autor SHA1 Wiadomość Data
Michael Barry fa7bffb04f
Add whole-tile postprocess hook (#802) 2024-01-23 07:08:18 -05:00
Michael Barry 96eae6110b
Archive compare (#780) 2024-01-10 05:21:03 -05:00
Björn Bilger c480b35f1c
Add support for "files"-archive (#761)
* Add support for "files"-archive

i.e. write individual pbf-files to disk in the format <base>/z/x/y.pbf

in order to use that format it must be passed as "--ouput=/path/to/tiles?format=files"

Fixes #536

* default to files format

...if no explict format query param given, path ends with a slash, or no extension given

* output metadata.json in files-archive

and refactor TileArchiveMetadata
1. put zoom into center (CoordinateXY->Coordinate) - in sync with mbtiles-format
2. add (De-)Serializer for Coordinate+Envelop => avoid duplication and cleaner
3. change the json and proto output for TileArchiveMetadata to be (more) in sync with mbtiles-format

* add support for custom tile scheme in files-archive

{z}/{x}/{y}.pbf is the default and can be configured as needed - e.g.:
- different order: {x}/{y}/{z}.pbf
- with intermediate dirs: {x}/a/{y}/b/{z}.pbf
- with different extension: {z}/{y}/{y}.pbf.gz

instead of {x} and {y}, {xs} and {xy} can be used which breaks up
x and y into 2 directories each and ensures that each directory has <1000 children

* fix issues with multiple writers

1. call finish archive only once after all writers are finished
   ...and not every time a writer finishes
2. log "zoom-progress" for the first tile write only
   (Finished z11 ... now starting z12)
3. remove file/dir-size progress logger bottleneck for files archive
   => each archive now reports the bytes written, which also fixes
   the issues of stream-archives reporting the size incorrectly
4. introduce printStats-hook on archive-level

* add async file write support to files archive

...allow to use virtual threads ExecturService (bound only!) for tile writing

also add some benchmark for writing tiles to disk: fixed, bound virtual, async, unbound virtual

* Revert "add async file write support to files archive"

This reverts commit b8cfa56977d98520aa8b62252c3a2726d440afe0.

* few improvements

- extract TileSchemeEncoding
- use Counter.MultithreadCounter rather than LongAdder to count bytes written
- add some JavaDoc

* simplify files archive usage

1. allow to pass tile scheme directly via output: --output=tiles/{x}/{y}/{z}.pbf
2. auto-encode { (%7B) and } (%7D) => no need to encode it the URI on CLI

* few more adjustments according to PR feeback

1. use WriteableTileArchive#bytesWritten in summmary as well
2. call WriteableTileArchive#init in a safer manner

..and a few more adjustments

* more PR feedback
2024-01-02 20:37:49 -05:00
Michael Barry 1b53493ac7
Upgrade omt to pull in tile size optimizations (#672) 2023-09-25 06:04:53 -04:00
Michael Barry 1f23b55274
Tile stats (#656) 2023-09-21 21:44:09 -04:00
Björn Bilger db796e1720
Add support for simple file output streams: CSV, JSON, protobuf (#639) 2023-08-23 20:24:27 -04:00
Michael Barry 509795401e
Fix geometry errors (#526) 2023-03-20 16:41:18 -04:00
Michael Barry 74db638dbc
Expose pmtiles writer (#520) 2023-03-18 14:38:04 -04:00
Brandon Liu 93af11bb26
Expose setId in FeatureCollector [#377] (#514) 2023-03-15 10:28:16 -04:00
Peter Hanecak 4a622a8ef0
Tile hashing fix (#436) 2023-01-14 16:03:50 -05:00
Michael Barry 93fe75782e
Improve shapefile zip reads (#314) 2022-07-31 07:17:42 -04:00
Brian Sperlongano da12fef79f
Declarative schema from configuration file (#160) 2022-06-07 17:34:21 -04:00
Björn Bilger f5206b3a73
add compact DB mode (--compact-db) to de-duplicate mbtiles output (#219) 2022-05-24 17:46:56 -04:00
Michael Barry 313a695abb
Handle more than one centerline for a lake (#139) 2022-03-19 15:16:11 -04:00
Michael Barry cce51668f2
Migrate to eclipse formatter to support multiple IDEs (#122) 2022-03-08 21:08:03 -05:00
Mike Barry e7e5cd88c4 fix warnings 2022-02-23 20:45:56 -05:00
Mike Barry b6ba928be1 Revert "allow using label grid on lines and polygons too (#51)"
This reverts commit 1c622ffdfb.
2022-01-10 06:41:15 -05:00
Michael Barry 1c622ffdfb
allow using label grid on lines and polygons too (#51) 2022-01-09 12:02:46 -05:00
Michael Barry 9e9cf7c413
Change name to Planetiler (#40)
* change name from flatmap to planetiler
* bump version to 0.2-SNAPSHOT
2021-12-23 05:42:24 -05:00