mirror
/
planetiler
kopia lustrzana https://github.com/onthegomap/planetiler
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność
894 Commity
95 Gałęzie
11 Tagi
58 MiB
Wykres commitów

130 Commity (main)

Autor SHA1 Wiadomość Data
Michael Barry 39956e61fb
Use snappy compression for `--compress-temp` flag (#905) 2024-05-30 06:38:45 -04:00
Michael Barry 2cc1e2bd32
Make sure feature collector can handle structs (#904) 2024-05-30 05:37:09 -04:00
Michael Barry 21f061efe0
Add support for linear-referenced tags. (#900) 2024-05-30 05:19:15 -04:00
Michael Barry 9dbd5d358e
Avoid deserializing entire geometry just to determine type (#898) 2024-05-26 07:11:43 -04:00
Michael Barry f8e64a4beb
Make VectorTile.Feature implement WithTags (#896) 2024-05-26 06:51:10 -04:00
Michael Barry fb22392580
Structured tag api (#895) 2024-05-25 05:21:37 -04:00
Michael Barry 1cd8c988b7
remove primary geometry from parquet feature tags (#893) 2024-05-23 06:25:11 -04:00
Michael Barry fb1d0e3bd6
Iniitial geoparquet support (#888) 2024-05-22 05:55:57 -04:00
Michael Barry ef1702ec73
ignore duplicate relation members (#876) 2024-05-02 06:21:01 -04:00
Michael Barry 978c64f0c6
Add polygon index intersection utility (#866) 2024-04-10 07:12:29 -04:00
Michael Barry f69882addb
Fix tile size stats memory leak (#861) 2024-04-02 20:34:42 -04:00
Michael Barry f7a3b62170
Add `firstCoordinate` vector tile feature helper (#814) 2024-02-03 09:35:20 -05:00
Michael Barry 7c03592358
Add tile post-process hook to forwarding profile (#813) 2024-02-03 06:14:08 -05:00
Michael Barry 384f84f51a
omit() feature collector api and --refresh-sources arg (#810) 2024-01-30 07:40:02 -05:00
Michael Barry fa7bffb04f
Add whole-tile postprocess hook (#802) 2024-01-23 07:08:18 -05:00
Brandon Liu 67d530a526
add extraMetadata to profile interface [#794] (#795) 2024-01-17 06:03:17 -05:00
Michael Barry bf24ef3961
Check for deterministic output in CI (#792) 2024-01-15 14:14:17 -05:00
Michael Barry 14b217d6f6
Fix feature merge consistent ordering (#789) 2024-01-14 12:08:20 -05:00
Michael Barry 062528b1ee
Make OSM polygon construction deterministic (#788) 2024-01-12 09:01:09 -05:00
Michael Barry 0dc2ee82e1
Deterministic merging (#785) 2024-01-11 08:42:16 -05:00
Michael Barry 96eae6110b
Archive compare (#780) 2024-01-10 05:21:03 -05:00
Björn Bilger df804879ef
remove log4j-CloseShieldOutputStream usage (#779) 2024-01-09 18:14:28 -05:00
Björn Bilger c480b35f1c
Add support for "files"-archive (#761) 
* Add support for "files"-archive

i.e. write individual pbf-files to disk in the format <base>/z/x/y.pbf

in order to use that format it must be passed as "--ouput=/path/to/tiles?format=files"

Fixes #536

* default to files format

...if no explict format query param given, path ends with a slash, or no extension given

* output metadata.json in files-archive

and refactor TileArchiveMetadata
1. put zoom into center (CoordinateXY->Coordinate) - in sync with mbtiles-format
2. add (De-)Serializer for Coordinate+Envelop => avoid duplication and cleaner
3. change the json and proto output for TileArchiveMetadata to be (more) in sync with mbtiles-format

* add support for custom tile scheme in files-archive

{z}/{x}/{y}.pbf is the default and can be configured as needed - e.g.:
- different order: {x}/{y}/{z}.pbf
- with intermediate dirs: {x}/a/{y}/b/{z}.pbf
- with different extension: {z}/{y}/{y}.pbf.gz

instead of {x} and {y}, {xs} and {xy} can be used which breaks up
x and y into 2 directories each and ensures that each directory has <1000 children

* fix issues with multiple writers

1. call finish archive only once after all writers are finished
   ...and not every time a writer finishes
2. log "zoom-progress" for the first tile write only
   (Finished z11 ... now starting z12)
3. remove file/dir-size progress logger bottleneck for files archive
   => each archive now reports the bytes written, which also fixes
   the issues of stream-archives reporting the size incorrectly
4. introduce printStats-hook on archive-level

* add async file write support to files archive

...allow to use virtual threads ExecturService (bound only!) for tile writing

also add some benchmark for writing tiles to disk: fixed, bound virtual, async, unbound virtual

* Revert "add async file write support to files archive"

This reverts commit b8cfa56977d98520aa8b62252c3a2726d440afe0.

* few improvements

- extract TileSchemeEncoding
- use Counter.MultithreadCounter rather than LongAdder to count bytes written
- add some JavaDoc

* simplify files archive usage

1. allow to pass tile scheme directly via output: --output=tiles/{x}/{y}/{z}.pbf
2. auto-encode { (%7B) and } (%7D) => no need to encode it the URI on CLI

* few more adjustments according to PR feeback

1. use WriteableTileArchive#bytesWritten in summmary as well
2. call WriteableTileArchive#init in a safer manner

..and a few more adjustments

* more PR feedback
 2024-01-02 20:37:49 -05:00
Brandon Liu a233e683bd
fix center coordinates of pmtiles writer (#769) 2023-12-28 06:43:00 -05:00
Michael Barry a78e6284a8
Use push-down bbox filter for shapefiles (#757) 2023-12-18 07:06:00 -05:00
Michael Barry cbb092a1f7
Compute layer attr stats from actual vector tile features (#752) 2023-12-14 19:26:27 -05:00
Mike Barry 699277b17f clearStage at start 2023-11-20 08:53:01 -05:00
Michael Barry 1df1bf04e4
Add `setAttrWithMinSize` to feature API (#725) 2023-11-20 06:15:52 -05:00
Michael Barry ae7261246f
Add API for maximum inscribed circle/pole of inaccessibility centerpoint of a polygon (#723) 2023-11-14 07:44:47 -05:00
Michael Barry ec6430dc49
Min polygon area centroid (#720) 2023-11-13 07:16:55 -05:00
Michael Barry 517851435d
Fix buffer union unbuffer exceptions (#713) 2023-11-07 07:28:00 -05:00
Michael Barry 44f22b27c5
Rewrite downloader using virtual threads (#702) 2023-11-01 19:30:28 -04:00
Michael Barry a94ac0ddd8
Add detailed jts debugging info (#703) 2023-10-30 22:14:46 -04:00
Michael Barry 9f960022b8
Logging fix (#699) 2023-10-27 20:40:45 -04:00
Michael Barry 1be2fca45f
Use some new Java 21 features (#695) 2023-10-27 20:29:26 -04:00
dependabot[bot] 015f418405
Bump geotools.version from 29.2 to 30.0 (#685) 
* Bump geotools.version from 29.2 to 30.0

Bumps `geotools.version` from 29.2 to 30.0.

Updates `org.geotools:gt-shapefile` from 29.2 to 30.0

Updates `org.geotools:gt-epsg-hsql` from 29.2 to 30.0

---
updated-dependencies:
- dependency-name: org.geotools:gt-shapefile
  dependency-type: direct:production
  update-type: version-update:semver-major
- dependency-name: org.geotools:gt-epsg-hsql
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix geotools breaking changes

* fix tests

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mike Barry <msb5014@gmail.com>
 2023-10-20 06:59:28 -04:00
Michael Barry e7e18d5f17
Sort merged vector tile features by hilbert order (#673) 2023-09-26 20:56:04 -04:00
Michael Barry 1b53493ac7
Upgrade omt to pull in tile size optimizations (#672) 2023-09-25 06:04:53 -04:00
Michael Barry 2f86ea12ae
Utilities to reduce tile size (#669) 2023-09-24 08:10:47 -04:00
Michael Barry 1f23b55274
Tile stats (#656) 2023-09-21 21:44:09 -04:00
Björn Bilger db796e1720
Add support for simple file output streams: CSV, JSON, protobuf (#639) 2023-08-23 20:24:27 -04:00
Michael Barry a48a9c8391
Page through S3 index (#608) 2023-06-21 20:43:37 -04:00
Erik Price cced1920d4
Add support for Overture maps downloads. (#599) 2023-06-08 09:01:01 -07:00
Michael Barry bf86516fab
Fallback to lenient shapefile parsing (#570) 2023-04-27 08:30:55 -04:00
Michael Barry 8d0e06c667
Fix invalid polygons before snapping to tile coordinates (#566) 2023-04-27 08:19:31 -04:00
Erik Price 2450c9d9f7
Exclude relations with invalid multipolygon geometry (#564) 2023-04-25 19:16:01 -04:00
Michael Barry 738e181657
handle empty geopackage geometries (#561) 2023-04-24 06:43:03 -04:00
Michael Barry 509795401e
Fix geometry errors (#526) 2023-03-20 16:41:18 -04:00
Michael Barry 97231d18ef
Add --keep-unzipped option to avoid unzipping sources each time (#522) 2023-03-19 14:01:17 -04:00
Michael Barry 74db638dbc
Expose pmtiles writer (#520) 2023-03-18 14:38:04 -04:00