Michael Barry
738e181657
handle empty geopackage geometries ( #561 )
2023-04-24 06:43:03 -04:00
Michael Barry
72ea82cd50
Fall back to slower transliterator ( #543 )
2023-03-31 06:33:12 -04:00
Michael Barry
509795401e
Fix geometry errors ( #526 )
2023-03-20 16:41:18 -04:00
Michael Barry
97231d18ef
Add --keep-unzipped option to avoid unzipping sources each time ( #522 )
2023-03-19 14:01:17 -04:00
Michael Barry
74db638dbc
Expose pmtiles writer ( #520 )
2023-03-18 14:38:04 -04:00
Michael Barry
c5d6daf671
metadataTable alias ( #517 )
2023-03-15 13:15:57 -04:00
Brandon Liu
93af11bb26
Expose setId in FeatureCollector [ #377 ] ( #514 )
2023-03-15 10:28:16 -04:00
Brandon Liu
d5b404d8e2
Finish PMTiles write implementation and basic reader ( #502 )
2023-03-13 13:56:11 -04:00
Michael Barry
1375ee7abb
Support disabling colors in terminal output ( #501 )
2023-02-25 07:45:45 -05:00
Michael Barry
f4d07ea141
Detect certain kinds of invalid polygons when slicing into tiles ( #499 )
2023-02-24 13:14:50 -05:00
Michael Barry
9c318e45b0
Update ReadableTileArchive.java ( #486 )
2023-02-14 05:41:28 -05:00
Brandon Liu
9bf62d5644
Pmtiles package low level header and directory serialization/deserialization [ #98 ] ( #466 )
2023-02-08 06:44:04 -05:00
Michael Barry
9a704e773e
Convert get all tile coords to iterator ( #463 )
2023-02-05 14:16:05 -05:00
Michael Barry
78129905e5
Add `--download-max-bandwidth` option ( #467 )
2023-01-30 13:38:09 -05:00
Brandon Liu
88daeb4d0b
Speed up VarInt encoding, remove emitTilesInOrder option [ #98 ] ( #460 )
2023-01-27 08:12:54 -05:00
Brandon Liu
9ce9d1f5b2
FeatureGroup can emit in either TMS or Hilbert order. [ #98 ] ( #455 )
2023-01-26 21:43:07 -05:00
Michael Barry
723f44e236
Improve is convex logic ( #459 )
2023-01-26 12:03:58 -05:00
Erik Price
4f43f1127a
Revert "fix is convex negated ( #241 )" ( #458 )
...
This reverts commit f93e5221f8
.
2023-01-26 04:59:37 -05:00
Brandon Liu
f772180fb7
refactor VectorLayers from mbtiles into util.LayerStats [ #98 ] ( #456 )
2023-01-25 21:15:43 -05:00
Erik Price
a0f8c67c78
Support unzipping GeoPackage sources at runtime ( #430 )
2023-01-25 20:56:30 -05:00
Brandon Liu
b97d9d0e79
fix CloseableConsumer class name ( #454 )
2023-01-23 06:06:57 -05:00
Brandon Liu
1afb5de820
add VarInt encoder for unsigned longs [ #98 ] ( #449 )
2023-01-23 05:58:23 -05:00
Brandon Liu
09fd4ba2ba
Tile archive refactor ( #443 )
2023-01-17 07:05:45 -05:00
Peter Hanecak
4a622a8ef0
Tile hashing fix ( #436 )
2023-01-14 16:03:50 -05:00
Erik Price
ef24e91f0b
Add basic support for reading GeoPackage files. ( #413 )
2023-01-02 12:19:05 -05:00
Michael Barry
aea309e094
add layer to shapefile ( #429 )
2023-01-02 11:41:12 -05:00
Michael Barry
dad2073f61
Add planetiler-specific metadata ( #428 )
2023-01-02 11:26:00 -05:00
Erik Price
184f950051
Extract ZIP file walker out of ShapefileReader. ( #423 )
2023-01-01 17:29:00 -05:00
Erik Price
ea8589bd6f
Add shapefile directory source ( #406 )
2022-12-15 14:19:22 -05:00
Michael Barry
926bc9210b
Switch ordering of translation providers ( #403 )
2022-12-01 17:26:04 -05:00
Erik Price
9e4eb45baa
Fix max tile size in stats output. ( #399 )
2022-11-30 20:18:45 -05:00
Erik Price
762d052b10
Remove outdated reference to "relation_member" type ( #397 )
2022-11-29 18:15:35 -05:00
ttomasz
6a893a4787
Cli add version argument ( #376 )
2022-11-26 06:59:13 -05:00
Erik Price
ccf098115e
Move NumberFormat to thread-local variable ( #387 )
...
* Move NumberFormat to thread-local variable
The NumberFormat class isn't thread safe, and sharing one instance
across threads allowed for races which resulted in otherwise valid OSM
tags not being parsed correctly.
* Add supression for ThreadLocal use
* Use ThreadLocal for NumberFormat objects in `Format`
* Wrap `NumberFormat` instances rather than hashmap
2022-11-21 20:34:28 -05:00
Erik Price
7f6032b641
Fix NPE for `OsmReader#estimateMemoryUsageBytes()` ( #389 )
...
A `NullPointerException` was thrown when this method was called after
calling `close()` (which happens when using the `PrometheusStats`
client).
2022-11-21 15:13:29 -05:00
Michael Barry
0eb148ee3c
Expose arguments via config ( #363 )
2022-10-04 19:57:59 -04:00
Michael Barry
5296d1772e
Shortbread schema ( #323 )
2022-09-23 06:49:09 -04:00
Michael Barry
9e0eec93c8
Add `quickstart.sh` script to run with recommended settings ( #318 )
2022-08-10 05:09:33 -04:00
Michael Barry
4cc139a603
Improve geofabrik area search ( #317 )
2022-08-09 07:13:45 -04:00
Michael Barry
93fe75782e
Improve shapefile zip reads ( #314 )
2022-07-31 07:17:42 -04:00
Michael Barry
7fa51c1c02
Generate protobuf during build ( #310 )
2022-07-29 08:31:26 -04:00
Adam Laža
88c7f5650f
Move basemap profile into OpenMapTiles submodule ( #258 )
2022-07-29 06:40:15 -04:00
Michael Barry
8a8db0005d
Lazy primitive group deserialization ( #309 )
2022-07-28 07:56:41 -04:00
Michael Barry
621a8ed759
Support zoom levels up to 15 ( #303 )
2022-07-26 07:51:31 -04:00
Brandon Liu
a50c43835d
TileCoord supports up to zoom 15 using alternate ordering ( #266 )
2022-07-24 06:40:43 -04:00
Mike Barry
aa40e083c5
rm unnecessary main
2022-07-22 06:54:36 -04:00
farfromrefuge
7818634774
feat: `--polygon` argument to constrain mbtiles to a poly shape ( #280 )
2022-07-22 06:48:04 -04:00
Michael Barry
d1d68cf753
Memory-mapped lazy reads by default ( #300 )
2022-07-20 08:06:08 -04:00
Michael Barry
0e6394036c
Fix bounds check on dense nodes ( #301 )
2022-07-20 07:44:15 -04:00
Michael Barry
c6ad30cc9a
OSM QA Tiles Example Profile ( #278 )
2022-07-14 05:26:53 -04:00
Michael Barry
52432b815b
Fix memoize bug ( #279 )
2022-06-20 07:32:55 -04:00
farfromrefuge
76c7880d6b
feat: added `maxzoomForRendering` and `minzoomForRendering` ( #272 )
2022-06-20 06:31:50 -04:00
Brian Sperlongano
3fd094ddae
Allow more than 256 attribute keys ( #275 )
2022-06-20 05:37:40 -04:00
farfromrefuge
b9d91e47cf
fix: merge line if it needs to be simplified ( #244 )
2022-06-10 06:45:12 -04:00
Brian Sperlongano
da12fef79f
Declarative schema from configuration file ( #160 )
2022-06-07 17:34:21 -04:00
Michael Barry
bed2220e83
Cheap isFill check and add `--skip-filled-tiles` option ( #234 )
2022-06-03 21:04:17 -04:00
Michael Barry
b0f634bcaf
Use fnv1a64 for tile hash ( #253 )
2022-06-03 20:44:49 -04:00
Michael Barry
4ba36655d4
Fall back to parsing bounds from all nodes ( #251 )
2022-06-03 05:25:17 -04:00
Michael Barry
2ccef9f7f6
Unsynchronize ICU4j transliterate ( #246 )
2022-06-01 21:31:49 -04:00
Björn Bilger
97642fc096
Improve DB Indexes and Fix Deferred Index Logging in Compact DB Mode ( #245 )
2022-06-01 21:29:59 -04:00
Michael Barry
f93e5221f8
fix is convex negated ( #241 )
2022-05-30 08:15:40 -04:00
Michael Barry
4ecc96e9d9
enable by default ( #236 )
2022-05-28 05:23:36 -04:00
Michael Barry
99c0f8ae9c
Add `--feature-read-threads` option to read features in parallel when writing tiles ( #225 )
2022-05-24 18:46:52 -04:00
Björn Bilger
f5206b3a73
add compact DB mode (--compact-db) to de-duplicate mbtiles output ( #219 )
2022-05-24 17:46:56 -04:00
Michael Barry
dab37f572e
Handle elevations in units besides meters ( #226 )
2022-05-17 20:23:11 -04:00
Michael Barry
a8bec7a56d
Run nested tests ( #218 )
2022-05-08 21:12:31 -04:00
Michael Barry
9062e6b79b
Use custom min-heap to improve k-way merge by 30-50% ( #217 )
2022-05-08 20:00:13 -04:00
Michael Barry
726e6d0107
Parallel temp feature writes using `--write-threads` argument ( #213 )
2022-05-05 22:02:18 -04:00
Michael Barry
3589fc61f3
More robust multiexpression filtering ( #206 )
2022-05-04 20:30:47 -04:00
Michael Barry
01b52f9812
Add `--mmap-temp` option to use memory-mapped IO for temp feature files ( #209 )
2022-05-03 08:59:15 -04:00
Brian Sperlongano
891537e2bc
Implement matchField testing for Expression.not ( #201 )
2022-04-30 09:42:24 -04:00
Michael Barry
186af36c42
Minimize number of temp feature chunk files ( #199 )
2022-04-28 20:14:44 -04:00
Brian Sperlongano
ffb157414e
Data type support for Expression / MultiExpression ( #190 )
2022-04-28 07:08:00 -04:00
Michael Barry
b04f4cde0b
Review thread local warnings ( #196 )
2022-04-27 07:24:14 -04:00
Michael Barry
2db49fc76f
Fix sonar issues with unclosed resources ( #195 )
2022-04-26 06:26:05 -04:00
Michael Barry
5341d4d712
Fix sonar warnings ( #181 )
2022-04-23 05:58:49 -04:00
Michael Barry
4983bbc04e
0.4.0 tweaks ( #153 )
...
* tweaks from running on planet
* add no building merge log
* table format
* update maven descriptions
2022-03-31 06:42:28 -04:00
Yuri Astrakhan
bc66bbd352
Linting - spelling, tiny cleanups ( #150 )
...
* Linting - spelling, tiny cleanups
Grammar fixes, marked one place as `final`, etc.
* formatting
2022-03-27 05:49:58 -04:00
Mike Barry
96b6f200c6
fix multipolygon size estimate
2022-03-25 19:47:49 -04:00
Mike Barry
11cb4ade2e
fix --madvise flag
2022-03-25 19:47:31 -04:00
Michael Barry
2a8ac32350
Improve name:latin logic ( #147 )
...
* name:latin improvements
* improve latin letter regex
* allow region codes and x-extension's on localized names
2022-03-25 05:39:12 -04:00
Mike Barry
724c451f5c
fix hasTag variants
2022-03-23 05:37:20 -04:00
Michael Barry
e20b41c88d
Offload multipolygon storage to disk (reduce memory usage by 10-15gb) ( #141 )
2022-03-22 20:34:54 -04:00
Michael Barry
313a695abb
Handle more than one centerline for a lake ( #139 )
2022-03-19 15:16:11 -04:00
Michael Barry
bf081692ce
Node location cache: off-heap storage and “array” implementation that supports parallel inserts ( #131 )
...
* Add --nodemap-type=array option for 2-3x faster osm pass 1 imports
* Add --nodemap-storage=direct option to experiment with direct (off-heap) memory usage
* Extract ResourceUsage and OsmPhaser utilities
2022-03-19 05:46:03 -04:00
Mike Barry
ba7b861a8f
remove reference to old profile name
2022-03-17 20:19:29 -04:00
Oliver Wipfli
1cfcca2e20
Read shapefiles in UTF-8 mode ( #137 )
2022-03-17 08:26:13 -04:00
Oliver Wipfli
332e631507
Check disk space and memory only with OSM input file ( #138 )
2022-03-16 05:42:44 -04:00
Michael Barry
0a064797fb
Memory-mapped file improvements ( #103 )
...
* Use large memory-mapped file segments to avoid running out of space on smaller machines
* Add `--nodemap-madvise` argument to opt into madvise(random) for memory-mapped file access
2022-03-09 07:22:33 -05:00
Michael Barry
cce51668f2
Migrate to eclipse formatter to support multiple IDEs ( #122 )
2022-03-08 21:08:03 -05:00
Michael Barry
1ce2b5f76c
Retry wikidata requests ( #115 )
2022-03-05 08:52:20 -05:00
Mike Barry
3767cc4719
check disk space and memory after wikidata/download early exit
2022-03-04 05:18:27 -05:00
Michael Barry
e93ff79a01
Log direct memory usage ( #108 )
2022-03-03 20:21:25 -05:00
Mike Barry
0ddba6e9a7
actually delete after run
2022-03-03 08:32:04 -05:00
Michael Barry
20c7a05caa
Warn when running with insufficient memory or disk space ( #73 )
2022-03-03 07:25:24 -05:00
Michael Barry
8a6997f9dc
Remove graphhopper dependency ( #101 )
2022-03-01 08:43:19 -05:00
Michael Barry
2f05f942b2
Custom PBF parsing ( #82 )
...
Pull in pbf parsing to give more control over threading model and performance.
2022-02-28 20:52:30 -05:00
Michael Barry
0d727c4302
Thread stats ( #85 )
...
Add more detailed thread and GC stats to summary.
2022-02-24 08:19:44 -05:00
Mike Barry
e7e5cd88c4
fix warnings
2022-02-23 20:45:56 -05:00
Michael Barry
209361eb7e
Support for each loop in workers ( #83 )
2022-02-23 20:32:41 -05:00