da8e4afe59
require same tile ordering
2024-01-12 07:14:45 -05:00
6cca1b4c12
comment
2024-01-12 07:01:50 -05:00
17d93d63dc
improve test coverage
2024-01-12 06:54:25 -05:00
142d96ab5d
comments
2024-01-12 06:42:48 -05:00
b848f69e2a
make OSM polygon construction deterministic
2024-01-12 06:32:13 -05:00
43e39ef1ea
Bump org.msgpack:msgpack-core from 0.9.6 to 0.9.7 ( #784 )
...
Bumps [org.msgpack:msgpack-core](https://github.com/msgpack/msgpack-java ) from 0.9.6 to 0.9.7.
- [Release notes](https://github.com/msgpack/msgpack-java/releases )
- [Changelog](https://github.com/msgpack/msgpack-java/blob/main/RELEASE_NOTES.md )
- [Commits](https://github.com/msgpack/msgpack-java/compare/v0.9.6...v0.9.7 )
---
updated-dependencies:
- dependency-name: org.msgpack:msgpack-core
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-11 08:42:39 -05:00
0dc2ee82e1
Deterministic merging ( #785 )
2024-01-11 08:42:16 -05:00
96eae6110b
Archive compare ( #780 )
2024-01-10 05:21:03 -05:00
df804879ef
remove log4j-CloseShieldOutputStream usage ( #779 )
2024-01-09 18:14:28 -05:00
d2b267aa2e
Bump org.slf4j:slf4j-api from 2.0.10 to 2.0.11 ( #778 )
2024-01-09 05:05:09 -05:00
f692124168
Remove log4j usage ( #776 )
2024-01-09 05:04:44 -05:00
c480b35f1c
Add support for "files"-archive ( #761 )
...
* Add support for "files"-archive
i.e. write individual pbf-files to disk in the format <base>/z/x/y.pbf
in order to use that format it must be passed as "--ouput=/path/to/tiles?format=files"
Fixes #536
* default to files format
...if no explict format query param given, path ends with a slash, or no extension given
* output metadata.json in files-archive
and refactor TileArchiveMetadata
1. put zoom into center (CoordinateXY->Coordinate) - in sync with mbtiles-format
2. add (De-)Serializer for Coordinate+Envelop => avoid duplication and cleaner
3. change the json and proto output for TileArchiveMetadata to be (more) in sync with mbtiles-format
* add support for custom tile scheme in files-archive
{z}/{x}/{y}.pbf is the default and can be configured as needed - e.g.:
- different order: {x}/{y}/{z}.pbf
- with intermediate dirs: {x}/a/{y}/b/{z}.pbf
- with different extension: {z}/{y}/{y}.pbf.gz
instead of {x} and {y}, {xs} and {xy} can be used which breaks up
x and y into 2 directories each and ensures that each directory has <1000 children
* fix issues with multiple writers
1. call finish archive only once after all writers are finished
...and not every time a writer finishes
2. log "zoom-progress" for the first tile write only
(Finished z11 ... now starting z12)
3. remove file/dir-size progress logger bottleneck for files archive
=> each archive now reports the bytes written, which also fixes
the issues of stream-archives reporting the size incorrectly
4. introduce printStats-hook on archive-level
* add async file write support to files archive
...allow to use virtual threads ExecturService (bound only!) for tile writing
also add some benchmark for writing tiles to disk: fixed, bound virtual, async, unbound virtual
* Revert "add async file write support to files archive"
This reverts commit b8cfa56977d98520aa8b62252c3a2726d440afe0.
* few improvements
- extract TileSchemeEncoding
- use Counter.MultithreadCounter rather than LongAdder to count bytes written
- add some JavaDoc
* simplify files archive usage
1. allow to pass tile scheme directly via output: --output=tiles/{x}/{y}/{z}.pbf
2. auto-encode { (%7B) and } (%7D) => no need to encode it the URI on CLI
* few more adjustments according to PR feeback
1. use WriteableTileArchive#bytesWritten in summmary as well
2. call WriteableTileArchive#init in a safer manner
..and a few more adjustments
* more PR feedback
2024-01-02 20:37:49 -05:00
389ccab8e1
Bump org.slf4j:slf4j-api from 2.0.9 to 2.0.10 ( #770 )
2023-12-29 06:34:38 -05:00
a233e683bd
fix center coordinates of pmtiles writer ( #769 )
2023-12-28 06:43:00 -05:00
3dea746ff0
Bump log4j.version from 2.22.0 to 2.22.1 ( #768 )
2023-12-27 07:07:43 -05:00
e2aacfe75e
Bump com.google.guava:guava from 32.1.3-jre to 33.0.0-jre ( #762 )
...
Bumps [com.google.guava:guava](https://github.com/google/guava ) from 32.1.3-jre to 33.0.0-jre.
- [Release notes](https://github.com/google/guava/releases )
- [Commits](https://github.com/google/guava/commits )
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-21 06:18:23 -05:00
a78e6284a8
Use push-down bbox filter for shapefiles ( #757 )
2023-12-18 07:06:00 -05:00
d3d5ed8f0f
Bump org.roaringbitmap:RoaringBitmap from 1.0.0 to 1.0.1 ( #754 )
...
Bumps [org.roaringbitmap:RoaringBitmap](https://github.com/RoaringBitmap/RoaringBitmap ) from 1.0.0 to 1.0.1.
- [Release notes](https://github.com/RoaringBitmap/RoaringBitmap/releases )
- [Commits](https://github.com/RoaringBitmap/RoaringBitmap/compare/1.0.0...1.0.1 )
---
updated-dependencies:
- dependency-name: org.roaringbitmap:RoaringBitmap
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-15 05:13:50 -05:00
cbb092a1f7
Compute layer attr stats from actual vector tile features ( #752 )
2023-12-14 19:26:27 -05:00
c53fdea788
Bump com.ibm.icu:icu4j from 74.1 to 74.2 ( #748 )
...
Bumps [com.ibm.icu:icu4j](https://github.com/unicode-org/icu ) from 74.1 to 74.2.
- [Release notes](https://github.com/unicode-org/icu/releases )
- [Commits](https://github.com/unicode-org/icu/commits )
---
updated-dependencies:
- dependency-name: com.ibm.icu:icu4j
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-13 05:38:08 -05:00
1ac5b69b92
Bump mil.nga.geopackage:geopackage from 6.6.3 to 6.6.4 ( #743 )
2023-12-07 05:42:01 -05:00
40bf33e887
Access OSM metadata in yaml profiles ( #739 )
2023-12-02 15:34:35 -05:00
ed4c320e49
Bump org.xerial:sqlite-jdbc from 3.44.0.0 to 3.44.1.0 ( #735 )
2023-11-30 04:54:29 -05:00
dc04a62d81
Bump geotools.version from 30.0 to 30.1 ( #733 )
2023-11-29 19:05:44 -05:00
34f29eeda7
Bump com.google.protobuf:protobuf-java from 3.25.0 to 3.25.1 ( #730 )
2023-11-21 20:40:03 -05:00
699277b17f
clearStage at start
2023-11-20 08:53:01 -05:00
6209f4d36e
Bump log4j.version from 2.21.1 to 2.22.0 ( #727 )
...
Bumps `log4j.version` from 2.21.1 to 2.22.0.
Updates `org.apache.logging.log4j:log4j-slf4j2-impl` from 2.21.1 to 2.22.0
Updates `org.apache.logging.log4j:log4j-api` from 2.21.1 to 2.22.0
Updates `org.apache.logging.log4j:log4j-core` from 2.21.1 to 2.22.0
---
updated-dependencies:
- dependency-name: org.apache.logging.log4j:log4j-slf4j2-impl
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-api
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-20 08:15:26 -05:00
1df1bf04e4
Add `setAttrWithMinSize` to feature API ( #725 )
2023-11-20 06:15:52 -05:00
c22d379734
Bump jackson.version from 2.15.3 to 2.16.0 ( #726 )
2023-11-17 04:47:38 -05:00
c9f61df4cb
Bump org.xerial:sqlite-jdbc from 3.43.2.2 to 3.44.0.0 ( #724 )
2023-11-15 19:31:27 -05:00
ae7261246f
Add API for maximum inscribed circle/pole of inaccessibility centerpoint of a polygon ( #723 )
2023-11-14 07:44:47 -05:00
ec6430dc49
Min polygon area centroid ( #720 )
2023-11-13 07:16:55 -05:00
517851435d
Fix buffer union unbuffer exceptions ( #713 )
2023-11-07 07:28:00 -05:00
48050ed495
Bump com.google.protobuf:protobuf-java from 3.24.4 to 3.25.0 ( #706 )
2023-11-02 04:45:35 -04:00
44f22b27c5
Rewrite downloader using virtual threads ( #702 )
2023-11-01 19:30:28 -04:00
bf7294970e
Bump com.ibm.icu:icu4j from 73.2 to 74.1 ( #705 )
...
Bumps [com.ibm.icu:icu4j](https://github.com/unicode-org/icu ) from 73.2 to 74.1.
- [Release notes](https://github.com/unicode-org/icu/releases )
- [Commits](https://github.com/unicode-org/icu/commits )
---
updated-dependencies:
- dependency-name: com.ibm.icu:icu4j
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-01 05:19:57 -04:00
a94ac0ddd8
Add detailed jts debugging info ( #703 )
2023-10-30 22:14:46 -04:00
834d4587f1
Bump org.xerial:sqlite-jdbc from 3.43.2.1 to 3.43.2.2 ( #701 )
...
Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc ) from 3.43.2.1 to 3.43.2.2.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases )
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG )
- [Commits](https://github.com/xerial/sqlite-jdbc/compare/3.43.2.1...3.43.2.2 )
---
updated-dependencies:
- dependency-name: org.xerial:sqlite-jdbc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-30 06:27:41 -04:00
9f960022b8
Logging fix ( #699 )
2023-10-27 20:40:45 -04:00
1be2fca45f
Use some new Java 21 features ( #695 )
2023-10-27 20:29:26 -04:00
2bb05a0797
fix log4j log format ( #697 )
2023-10-26 07:30:56 -04:00
b23d7ea7f5
Bump log4j.version from 2.20.0 to 2.21.1 ( #694 )
...
Bumps `log4j.version` from 2.20.0 to 2.21.1.
Updates `org.apache.logging.log4j:log4j-slf4j2-impl` from 2.20.0 to 2.21.1
Updates `org.apache.logging.log4j:log4j-api` from 2.20.0 to 2.21.1
Updates `org.apache.logging.log4j:log4j-core` from 2.20.0 to 2.21.1
---
updated-dependencies:
- dependency-name: org.apache.logging.log4j:log4j-slf4j2-impl
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-api
dependency-type: direct:production
update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-core
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-26 06:27:11 -04:00
a50b06a38b
Bump org.xerial:sqlite-jdbc from 3.43.0.0 to 3.43.2.1 ( #692 )
...
Bumps [org.xerial:sqlite-jdbc](https://github.com/xerial/sqlite-jdbc ) from 3.43.0.0 to 3.43.2.1.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases )
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG )
- [Commits](https://github.com/xerial/sqlite-jdbc/compare/3.43.0.0...3.43.2.1 )
---
updated-dependencies:
- dependency-name: org.xerial:sqlite-jdbc
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-25 20:49:03 -04:00
015f418405
Bump geotools.version from 29.2 to 30.0 ( #685 )
...
* Bump geotools.version from 29.2 to 30.0
Bumps `geotools.version` from 29.2 to 30.0.
Updates `org.geotools:gt-shapefile` from 29.2 to 30.0
Updates `org.geotools:gt-epsg-hsql` from 29.2 to 30.0
---
updated-dependencies:
- dependency-name: org.geotools:gt-shapefile
dependency-type: direct:production
update-type: version-update:semver-major
- dependency-name: org.geotools:gt-epsg-hsql
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix geotools breaking changes
* fix tests
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Mike Barry <msb5014@gmail.com>
2023-10-20 06:59:28 -04:00
f858a462d1
Bump com.google.guava:guava from 32.1.2-jre to 32.1.3-jre ( #684 )
2023-10-13 05:54:14 -07:00
aa6a3a94eb
Bump com.google.protobuf:protobuf-java from 3.24.3 to 3.24.4 ( #682 )
2023-10-05 20:48:13 -04:00
076ac3e2f1
Bump mil.nga.geopackage:geopackage from 6.6.2 to 6.6.3 ( #681 )
...
Bumps [mil.nga.geopackage:geopackage](https://github.com/ngageoint/geopackage-java ) from 6.6.2 to 6.6.3.
- [Release notes](https://github.com/ngageoint/geopackage-java/releases )
- [Changelog](https://github.com/ngageoint/geopackage-java/blob/master/CHANGELOG.md )
- [Commits](https://github.com/ngageoint/geopackage-java/compare/6.6.2...6.6.3 )
---
updated-dependencies:
- dependency-name: mil.nga.geopackage:geopackage
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-04 05:18:04 -04:00
2b18ab1f70
Bump org.msgpack:msgpack-core from 0.9.5 to 0.9.6 ( #675 )
...
Bumps [org.msgpack:msgpack-core](https://github.com/msgpack/msgpack-java ) from 0.9.5 to 0.9.6.
- [Release notes](https://github.com/msgpack/msgpack-java/releases )
- [Changelog](https://github.com/msgpack/msgpack-java/blob/main/RELEASE_NOTES.md )
- [Commits](https://github.com/msgpack/msgpack-java/compare/v0.9.5...v0.9.6 )
---
updated-dependencies:
- dependency-name: org.msgpack:msgpack-core
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-29 05:30:48 -04:00
a1ef17db5b
Bump org.roaringbitmap:RoaringBitmap from 0.9.49 to 1.0.0 ( #674 )
2023-09-28 06:56:41 -04:00
e7e18d5f17
Sort merged vector tile features by hilbert order ( #673 )
2023-09-26 20:56:04 -04:00
Mike Barry