Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Apr 3, 2025

Bumps geotools.version from 32.2 to 33.0.
Updates org.geotools:gt-shapefile from 32.2 to 33.0

Updates org.geotools:gt-epsg-hsql from 32.2 to 33.0

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot dependabot bot added the dependencies Upgrading dependencies label Apr 3, 2025
@github-actions
Copy link

github-actions bot commented Apr 3, 2025

This Branch b5e1a89 Base faf557b
0:01:09 DEB [archive] - Tile stats:
0:01:09 DEB [archive] - Biggest tiles (gzipped)
1. 14/4942/6092 (157k) https://onthegomap.github.io/planetiler-demo/#14.5/41.82864/-71.40015 (poi:86k)
2. 9/154/190 (144k) https://onthegomap.github.io/planetiler-demo/#9.5/41.77078/-71.36719 (landcover:85k)
3. 10/308/380 (136k) https://onthegomap.github.io/planetiler-demo/#10.5/41.90214/-71.54297 (landcover:66k)
4. 10/308/381 (135k) https://onthegomap.github.io/planetiler-demo/#10.5/41.63994/-71.54297 (landcover:71k)
5. 14/4941/6092 (113k) https://onthegomap.github.io/planetiler-demo/#14.5/41.82864/-71.42212 (poi:65k)
6. 14/4941/6093 (112k) https://onthegomap.github.io/planetiler-demo/#14.5/41.81227/-71.42212 (building:62k)
7. 14/4940/6092 (101k) https://onthegomap.github.io/planetiler-demo/#14.5/41.82864/-71.44409 (building:92k)
8. 11/616/762 (98k) https://onthegomap.github.io/planetiler-demo/#11.5/41.7057/-71.63086 (landcover:71k)
9. 14/4942/6091 (96k) https://onthegomap.github.io/planetiler-demo/#14.5/41.84501/-71.40015 (building:79k)
10. 11/616/761 (95k) https://onthegomap.github.io/planetiler-demo/#11.5/41.83679/-71.63086 (landcover:72k)
0:01:09 DEB [archive] - Max tile sizes
                      z0    z1    z2    z3    z4    z5    z6    z7    z8    z9   z10   z11   z12   z13   z14   all
           boundary  151   336   409   544   872   332   437   552   802  1.6k    2k  6.9k  6.2k  5.6k  4.5k  6.9k
              water 7.7k  3.7k  8.6k  5.5k  2.6k  5.1k   15k   18k   16k   26k   15k   13k   17k   15k   12k   26k
              place    0     0   441   441   441   640   714    1k  1.6k  3.1k  5.8k  3.4k  1.7k   803   948  5.8k
            landuse    0     0     0     0   549   695  1.6k  6.7k   17k   44k   59k   50k   38k   19k   12k   59k
     transportation    0     0     0     0   313   776  1.2k    4k  5.6k   17k   13k   17k   63k   48k   33k   63k
           waterway    0     0     0     0   112   119     0     0     0  3.1k  2.2k    2k  2.1k  4.9k  2.4k  4.9k
               park    0     0     0     0     0     0  1.3k  4.3k  9.7k   18k   13k  8.2k  3.7k  3.4k  4.4k   18k
transportation_name    0     0     0     0     0     0   287   364  1.1k  1.9k  5.5k  4.7k  3.9k  3.4k   18k   18k
          landcover    0     0     0     0     0     0     0  9.9k   29k   85k   71k   81k   53k   30k   25k   85k
      mountain_peak    0     0     0     0     0     0     0  1.1k  1.8k  3.4k  4.3k  2.8k  1.4k  1.4k   869  4.3k
         water_name    0     0     0     0     0     0     0     0     0   486   461   433   452  1.2k  1.5k  1.5k
    aerodrome_label    0     0     0     0     0     0     0     0     0     0   666   328   273   221   221   666
            aeroway    0     0     0     0     0     0     0     0     0     0  1.6k  2.1k    3k  3.4k  2.8k  3.4k
                poi    0     0     0     0     0     0     0     0     0     0     0     0   568   565   86k   86k
           building    0     0     0     0     0     0     0     0     0     0     0     0     0   59k   92k   92k
        housenumber    0     0     0     0     0     0     0     0     0     0     0     0     0     0   35k   35k
          full tile 7.9k    4k  9.5k  6.4k  3.7k    6k   20k   41k   82k  195k  181k  134k  113k  128k  247k  247k
            gzipped 6.2k  3.5k  7.1k  5.2k  3.1k  4.8k   14k   29k   59k  144k  136k   98k   83k   92k  157k  157k
0:01:09 DEB [archive] -    Max tile: 247k (gzipped: 157k)
0:01:09 DEB [archive] -    Avg tile: 5.4k (gzipped: 4k) using weighted average based on OSM traffic
0:01:09 DEB [archive] -     # tiles: 4,115,040
0:01:09 DEB [archive] -  # features: 5,560,304
0:01:09 INF [archive] - Finished in 19s cpu:1m12s avg:3.7
0:01:09 INF [archive] -   read    1x(3% 0.5s wait:18s done:1s)
0:01:09 INF [archive] -   encode  4x(55% 11s wait:2s)
0:01:09 INF [archive] -   write   1x(21% 4s wait:13s)
0:01:09 INF [archive] - Finished in 1m10s cpu:3m38s gc:1s avg:3.1
0:01:09 INF [archive] - FINISHED!
0:01:09 INF [archive] - 
0:01:09 INF [archive] - ----------------------------------------
0:01:09 INF [archive] - data errors:
0:01:09 INF [archive] - 	render_snap_fix_input	16,778
0:01:09 INF [archive] - 	osm_multipolygon_missing_way	360
0:01:09 INF [archive] - 	osm_boundary_missing_way	55
0:01:09 INF [archive] - 	merge_snap_fix_input	13
0:01:09 INF [archive] - 	feature_centroid_if_convex_osm_invalid_multipolygon_empty_after_fix	2
0:01:09 INF [archive] - 	render_snap_fix_input2	1
0:01:09 INF [archive] - 	omt_fix_water_before_ne_intersect	1
0:01:09 INF [archive] - 	feature_polygon_osm_invalid_multipolygon_empty_after_fix	1
0:01:09 INF [archive] - 	feature_point_on_surface_osm_invalid_multipolygon_empty_after_fix	1
0:01:09 INF [archive] - ----------------------------------------
0:01:09 INF [archive] - 	overall          1m10s cpu:3m38s gc:1s avg:3.1
0:01:09 INF [archive] - 	lake_centerlines 3s cpu:6s avg:2.2
0:01:09 INF [archive] - 	  read     1x(17% 0.5s done:2s)
0:01:09 INF [archive] - 	  process  4x(0% 0s done:2s)
0:01:09 INF [archive] - 	  write    1x(0% 0s done:2s)
0:01:09 INF [archive] - 	water_polygons   14s cpu:38s avg:2.7
0:01:09 INF [archive] - 	  read     1x(42% 6s done:7s)
0:01:09 INF [archive] - 	  process  4x(26% 4s wait:4s done:5s)
0:01:09 INF [archive] - 	  write    1x(3% 0.5s wait:9s done:5s)
0:01:09 INF [archive] - 	natural_earth    10s cpu:17s avg:1.6
0:01:09 INF [archive] - 	  read     1x(56% 6s done:5s)
0:01:09 INF [archive] - 	  process  4x(8% 0.8s wait:6s done:4s)
0:01:09 INF [archive] - 	  write    1x(0% 0s wait:6s done:4s)
0:01:09 INF [archive] - 	osm_pass1        2s cpu:6s avg:3.2
0:01:09 INF [archive] - 	  read     1x(2% 0s wait:2s)
0:01:09 INF [archive] - 	  parse    4x(33% 0.6s)
0:01:09 INF [archive] - 	  process  1x(72% 1s)
0:01:09 INF [archive] - 	osm_pass2        19s cpu:1m14s avg:3.9
0:01:09 INF [archive] - 	  read     1x(0% 0s wait:11s done:7s)
0:01:09 INF [archive] - 	  process  4x(76% 14s)
0:01:09 INF [archive] - 	  write    1x(2% 0.4s wait:18s)
0:01:09 INF [archive] - 	ne_lakes         0s cpu:0s avg:0
0:01:09 INF [archive] - 	boundaries       0s cpu:0s avg:1.2
0:01:09 INF [archive] - 	agg_stop         0s cpu:0s avg:0
0:01:09 INF [archive] - 	sort             1s cpu:4s avg:2.6
0:01:09 INF [archive] - 	  worker  1x(50% 0.7s)
0:01:09 INF [archive] - 	archive          19s cpu:1m12s avg:3.7
0:01:09 INF [archive] - 	  read    1x(3% 0.5s wait:18s done:1s)
0:01:09 INF [archive] - 	  encode  4x(55% 11s wait:2s)
0:01:09 INF [archive] - 	  write   1x(21% 4s wait:13s)
0:01:09 INF [archive] - ----------------------------------------
0:01:09 INF [archive] - 	archive	107MB
0:01:09 INF [archive] - 	features	286MB
-rw-r--r-- 1 runner docker 88M Apr  6 01:32 run.jar
0:01:04 DEB [archive] - Tile stats:
0:01:04 DEB [archive] - Biggest tiles (gzipped)
1. 14/4942/6092 (157k) https://onthegomap.github.io/planetiler-demo/#14.5/41.82864/-71.40015 (poi:86k)
2. 9/154/190 (144k) https://onthegomap.github.io/planetiler-demo/#9.5/41.77078/-71.36719 (landcover:85k)
3. 10/308/380 (136k) https://onthegomap.github.io/planetiler-demo/#10.5/41.90214/-71.54297 (landcover:66k)
4. 10/308/381 (135k) https://onthegomap.github.io/planetiler-demo/#10.5/41.63994/-71.54297 (landcover:71k)
5. 14/4941/6092 (113k) https://onthegomap.github.io/planetiler-demo/#14.5/41.82864/-71.42212 (poi:65k)
6. 14/4941/6093 (112k) https://onthegomap.github.io/planetiler-demo/#14.5/41.81227/-71.42212 (building:62k)
7. 14/4940/6092 (101k) https://onthegomap.github.io/planetiler-demo/#14.5/41.82864/-71.44409 (building:92k)
8. 11/616/762 (98k) https://onthegomap.github.io/planetiler-demo/#11.5/41.7057/-71.63086 (landcover:71k)
9. 14/4942/6091 (96k) https://onthegomap.github.io/planetiler-demo/#14.5/41.84501/-71.40015 (building:79k)
10. 11/616/761 (95k) https://onthegomap.github.io/planetiler-demo/#11.5/41.83679/-71.63086 (landcover:72k)
0:01:04 DEB [archive] - Max tile sizes
                      z0    z1    z2    z3    z4    z5    z6    z7    z8    z9   z10   z11   z12   z13   z14   all
           boundary  151   336   409   544   872   332   437   552   802  1.6k    2k  6.9k  6.2k  5.6k  4.5k  6.9k
              water 7.7k  3.7k  8.6k  5.5k  2.6k  5.1k   15k   18k   16k   26k   15k   13k   17k   15k   12k   26k
              place    0     0   441   441   441   640   714    1k  1.6k  3.1k  5.8k  3.4k  1.7k   803   948  5.8k
            landuse    0     0     0     0   549   695  1.6k  6.7k   17k   44k   59k   50k   38k   19k   12k   59k
     transportation    0     0     0     0   313   776  1.2k    4k  5.6k   17k   13k   17k   63k   48k   33k   63k
           waterway    0     0     0     0   112   119     0     0     0  3.1k  2.2k    2k  2.1k  4.9k  2.4k  4.9k
               park    0     0     0     0     0     0  1.3k  4.3k  9.7k   18k   13k  8.2k  3.7k  3.4k  4.4k   18k
transportation_name    0     0     0     0     0     0   287   364  1.1k  1.9k  5.5k  4.7k  3.9k  3.4k   18k   18k
          landcover    0     0     0     0     0     0     0  9.9k   29k   85k   71k   81k   53k   30k   25k   85k
      mountain_peak    0     0     0     0     0     0     0  1.1k  1.8k  3.4k  4.3k  2.8k  1.4k  1.4k   869  4.3k
         water_name    0     0     0     0     0     0     0     0     0   486   461   433   452  1.2k  1.5k  1.5k
    aerodrome_label    0     0     0     0     0     0     0     0     0     0   666   328   273   221   221   666
            aeroway    0     0     0     0     0     0     0     0     0     0  1.6k  2.1k    3k  3.4k  2.8k  3.4k
                poi    0     0     0     0     0     0     0     0     0     0     0     0   568   565   86k   86k
           building    0     0     0     0     0     0     0     0     0     0     0     0     0   59k   92k   92k
        housenumber    0     0     0     0     0     0     0     0     0     0     0     0     0     0   35k   35k
          full tile 7.9k    4k  9.5k  6.4k  3.7k    6k   20k   41k   82k  195k  181k  134k  113k  128k  247k  247k
            gzipped 6.2k  3.5k  7.1k  5.2k  3.1k  4.8k   14k   29k   59k  144k  136k   98k   83k   92k  157k  157k
0:01:04 DEB [archive] -    Max tile: 247k (gzipped: 157k)
0:01:04 DEB [archive] -    Avg tile: 5.4k (gzipped: 4k) using weighted average based on OSM traffic
0:01:04 DEB [archive] -     # tiles: 4,115,040
0:01:04 DEB [archive] -  # features: 5,560,304
0:01:04 INF [archive] - Finished in 19s cpu:1m10s avg:3.7
0:01:04 INF [archive] -   read    1x(3% 0.6s wait:17s done:1s)
0:01:04 INF [archive] -   encode  4x(57% 11s wait:2s done:1s)
0:01:04 INF [archive] -   write   1x(22% 4s wait:12s done:1s)
0:01:04 INF [archive] - Finished in 1m4s cpu:3m33s gc:1s avg:3.3
0:01:04 INF [archive] - FINISHED!
0:01:04 INF [archive] - 
0:01:04 INF [archive] - ----------------------------------------
0:01:04 INF [archive] - data errors:
0:01:04 INF [archive] - 	render_snap_fix_input	16,778
0:01:04 INF [archive] - 	osm_multipolygon_missing_way	360
0:01:04 INF [archive] - 	osm_boundary_missing_way	55
0:01:04 INF [archive] - 	merge_snap_fix_input	13
0:01:04 INF [archive] - 	feature_centroid_if_convex_osm_invalid_multipolygon_empty_after_fix	2
0:01:04 INF [archive] - 	render_snap_fix_input2	1
0:01:04 INF [archive] - 	omt_fix_water_before_ne_intersect	1
0:01:04 INF [archive] - 	feature_polygon_osm_invalid_multipolygon_empty_after_fix	1
0:01:04 INF [archive] - 	feature_point_on_surface_osm_invalid_multipolygon_empty_after_fix	1
0:01:04 INF [archive] - ----------------------------------------
0:01:04 INF [archive] - 	overall          1m4s cpu:3m33s gc:1s avg:3.3
0:01:04 INF [archive] - 	lake_centerlines 2s cpu:6s avg:2.5
0:01:04 INF [archive] - 	  read     1x(21% 0.5s done:2s)
0:01:04 INF [archive] - 	  process  4x(0% 0s done:2s)
0:01:04 INF [archive] - 	  write    1x(0% 0s done:2s)
0:01:04 INF [archive] - 	water_polygons   15s cpu:41s avg:2.8
0:01:04 INF [archive] - 	  read     1x(42% 6s done:7s)
0:01:04 INF [archive] - 	  process  4x(27% 4s wait:4s done:5s)
0:01:04 INF [archive] - 	  write    1x(4% 0.5s wait:9s done:5s)
0:01:04 INF [archive] - 	natural_earth    6s cpu:13s avg:2.1
0:01:04 INF [archive] - 	  read     1x(95% 6s)
0:01:04 INF [archive] - 	  process  4x(13% 0.8s wait:6s)
0:01:04 INF [archive] - 	  write    1x(0% 0s wait:6s)
0:01:04 INF [archive] - 	osm_pass1        2s cpu:6s avg:3.2
0:01:04 INF [archive] - 	  read     1x(2% 0s wait:2s)
0:01:04 INF [archive] - 	  parse    4x(33% 0.6s)
0:01:04 INF [archive] - 	  process  1x(71% 1s)
0:01:04 INF [archive] - 	osm_pass2        18s cpu:1m11s avg:3.9
0:01:04 INF [archive] - 	  read     1x(0% 0s wait:11s done:7s)
0:01:04 INF [archive] - 	  process  4x(76% 14s)
0:01:04 INF [archive] - 	  write    1x(2% 0.4s wait:18s)
0:01:04 INF [archive] - 	ne_lakes         0s cpu:0s avg:0
0:01:04 INF [archive] - 	boundaries       0s cpu:0s avg:1.1
0:01:04 INF [archive] - 	agg_stop         0s cpu:0s avg:0
0:01:04 INF [archive] - 	sort             1s cpu:3s avg:2.5
0:01:04 INF [archive] - 	  worker  1x(53% 0.7s)
0:01:04 INF [archive] - 	archive          19s cpu:1m10s avg:3.7
0:01:04 INF [archive] - 	  read    1x(3% 0.6s wait:17s done:1s)
0:01:04 INF [archive] - 	  encode  4x(57% 11s wait:2s done:1s)
0:01:04 INF [archive] - 	  write   1x(22% 4s wait:12s done:1s)
0:01:04 INF [archive] - ----------------------------------------
0:01:04 INF [archive] - 	archive	107MB
0:01:04 INF [archive] - 	features	286MB
-rw-r--r-- 1 runner docker 87M Apr  6 01:34 run.jar

Full logs: https://github.com/onthegomap/planetiler/actions/runs/14287686888

@MaRaSu
Copy link

MaRaSu commented Apr 5, 2025

I'm generating daily vector tiles with a modified planetiler-openmaptiles profile. Exactly 2 days ago my processing runs started to fail with the same error message that Github-actions bot is reporting above i.e. NE lake_centerlines processing stage started to fail.

@msbarry
Copy link
Contributor

msbarry commented Apr 5, 2025

Looks like if you manually download https://dev.maptiler.download/geodata/omt/lake_centerline.shp.zip then it is valid, but when planetiler downloads it the file gets corrupted. The size is the same on disk but all but the first 14kb of the file is blank

@msbarry
Copy link
Contributor

msbarry commented Apr 5, 2025

That seems to match up with what I'm seeing in the logs:

0:00:13 INF [download] -  lake_centerlines: [  13k   0% 1.3k/s ] water_polygons: [ 272M  31%  27M/s ] natural_earth: [ 433M 100%  43M/s ] osm: [ 642k 100%  64k/s ]  cpus: 0.5 gc:  0% heap: 40M/4.1G direct: 81k postGC: 62M
0:00:23 INF [download] -  lake_centerlines: [  13k   0%    0/s ] water_polygons: [ 578M  65%  30M/s ] natural_earth: [ 433M 100%    0/s ] osm: [ 642k 100%    0/s ]  cpus: 0.2 gc:  0% heap: 38M/4.1G direct: 81k postGC: 62M
0:00:32 INF [download:water_polygons] - Finished downloading https://osmdata.openstreetmap.de/download/water-polygons-split-3857.zip to data/sources/water-polygons-split-3857.zip
0:00:32 INF [download] -  lake_centerlines: [  13k   0%    0/s ] water_polygons: [ 886M 100%  30M/s ] natural_earth: [ 433M 100%    0/s ] osm: [ 642k 100%    0/s ]  cpus: 0.2 gc:  0% heap: 37M/4.1G direct: 81k postGC: 62M
0:00:32 INF [download] - Finished in 32s cpu:12s avg:0.4

lake_centerlines thinks it's finished but only says it's downloaded 13k 🤔

@msbarry
Copy link
Contributor

msbarry commented Apr 5, 2025

I added some logging but it seems to be intermittent so not seeing the issue now. @MaRaSu if you're able to run from this branch and share the logs it generates please share to help debug!

@msbarry msbarry force-pushed the dependabot/maven/geotools.version-33.0 branch from 5dc2149 to 67f1103 Compare April 6, 2025 00:55
@msbarry
Copy link
Contributor

msbarry commented Apr 6, 2025

@dependabot rebase

Bumps `geotools.version` from 32.2 to 33.0.

Updates `org.geotools:gt-shapefile` from 32.2 to 33.0

Updates `org.geotools:gt-epsg-hsql` from 32.2 to 33.0

---
updated-dependencies:
- dependency-name: org.geotools:gt-shapefile
  dependency-version: '33.0'
  dependency-type: direct:production
  update-type: version-update:semver-major
- dependency-name: org.geotools:gt-epsg-hsql
  dependency-version: '33.0'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot force-pushed the dependabot/maven/geotools.version-33.0 branch from 67f1103 to 58762ba Compare April 6, 2025 01:30
@msbarry
Copy link
Contributor

msbarry commented Apr 6, 2025

@MaRaSu I think it's a corrupted file hosted by maptiler. I changed the default download URLs for planetiler in #1238 but you can change your fork to use those URLs instead at least in the short term until maptiler fixes that.

@sonarqubecloud
Copy link

sonarqubecloud bot commented Apr 6, 2025

@msbarry msbarry merged commit 709e2cc into main Apr 6, 2025
19 of 20 checks passed
@dependabot dependabot bot deleted the dependabot/maven/geotools.version-33.0 branch April 6, 2025 01:42
@MaRaSu
Copy link

MaRaSu commented Apr 6, 2025

@msbarry I made the same URL change to planetiler-openmaptiles profile's OpenMapTilesMain.java file as you did in the PR #1238 and it seems to work. Then again I also got lucky by getting a successful processing run with Maptiler provided lake_centerlines, so it seems intermittent like you said.

I did another processing run with the changed URL and it went fine too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Upgrading dependencies

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants