OSM PBF Loader¶
OSMPbfLoader
can really quickly parse full OSM extract in the form of *.osm.pbf
file.
It can download and parse a lot of features much faster than the OSMOnlineLoader
, but it's much more useful when a lot of different features are required at once (like when using predefined filters).
When only a single or few features are needed, OSMOnlineLoader
might be a better choice, since OSMPbfLoader
will use a full extract of all features in a given region and will have to iterate over all of them.
import geopandas as gpd
from shapely.geometry import Point, box
from srai.constants import REGIONS_INDEX, WGS84_CRS
from srai.geometry import buffer_geometry
from srai.loaders.osm_loaders import OSMPbfLoader
from srai.loaders.osm_loaders.filters import GEOFABRIK_LAYERS, HEX2VEC_FILTER
from srai.loaders.osm_loaders.filters.popular import get_popular_tags
from srai.regionalizers import geocode_to_region_gdf
Using OSMPbfLoader to download data for a specific area¶
Download all features from HEX2VEC_FILTER
in Warsaw, Poland¶
loader = OSMPbfLoader()
warsaw_gdf = geocode_to_region_gdf("Warsaw, Poland")
warsaw_features_gdf = loader.load(warsaw_gdf, HEX2VEC_FILTER)
warsaw_features_gdf
/opt/hostedtoolcache/Python/3.10.14/x64/lib/python3.10/site-packages/srai/loaders/osm_loaders/osm_pbf_loader.py:128: FutureWarning: Use `convert_geometry_to_geodataframe` instead. Deprecated since 0.8.1 version. features_gdf = pbf_reader.get_features_gdf_from_geometry(
Downloading data from 'https://download.geofabrik.de/europe/poland/mazowieckie-latest.osm.pbf' to file '/home/runner/work/srai/srai/examples/loaders/files/Geofabrik_mazowieckie.osm.pbf'.
0%| | 0.00/258M [00:00<?, ?B/s]
0%| | 8.19k/258M [00:00<1:33:50, 45.9kB/s]
0%| | 36.9k/258M [00:00<38:41, 111kB/s]
0%| | 94.2k/258M [00:00<21:02, 204kB/s]
0%| | 186k/258M [00:00<10:55, 394kB/s]
0%| | 236k/258M [00:00<10:33, 407kB/s]
0%| | 324k/258M [00:00<08:02, 535kB/s]
0%| | 414k/258M [00:00<06:45, 635kB/s]
0%| | 504k/258M [00:01<06:06, 703kB/s]
0%| | 590k/258M [00:01<05:47, 740kB/s]
0%| | 676k/258M [00:01<05:38, 761kB/s]
0%| | 762k/258M [00:01<05:30, 780kB/s]
0%|▏ | 848k/258M [00:01<05:21, 801kB/s]
0%|▏ | 938k/258M [00:01<05:16, 813kB/s]
0%|▏ | 1.02M/258M [00:01<05:13, 820kB/s]
0%|▏ | 1.11M/258M [00:01<05:08, 833kB/s]
0%|▏ | 1.20M/258M [00:01<05:09, 830kB/s]
0%|▏ | 1.28M/258M [00:01<05:11, 825kB/s]
1%|▏ | 1.37M/258M [00:02<05:07, 836kB/s]
1%|▏ | 1.46M/258M [00:02<05:06, 838kB/s]
1%|▏ | 1.54M/258M [00:02<05:06, 836kB/s]
1%|▏ | 1.63M/258M [00:02<05:02, 847kB/s]
1%|▎ | 1.72M/258M [00:02<04:58, 860kB/s]
1%|▎ | 1.81M/258M [00:02<05:00, 853kB/s]
1%|▎ | 1.89M/258M [00:02<05:03, 846kB/s]
1%|▎ | 1.98M/258M [00:02<05:11, 822kB/s]
1%|▎ | 2.06M/258M [00:02<05:08, 829kB/s]
1%|▎ | 2.15M/258M [00:03<05:01, 850kB/s]
1%|▎ | 2.25M/258M [00:03<04:52, 874kB/s]
1%|▎ | 2.34M/258M [00:03<04:53, 873kB/s]
1%|▎ | 2.42M/258M [00:03<04:58, 858kB/s]
1%|▍ | 2.51M/258M [00:03<05:01, 848kB/s]
1%|▍ | 2.60M/258M [00:03<05:04, 840kB/s]
1%|▍ | 2.68M/258M [00:03<05:02, 844kB/s]
1%|▍ | 2.77M/258M [00:03<05:00, 851kB/s]
1%|▍ | 2.86M/258M [00:03<05:08, 827kB/s]
1%|▍ | 2.94M/258M [00:03<05:08, 828kB/s]
1%|▍ | 3.03M/258M [00:04<05:03, 841kB/s]
1%|▍ | 3.12M/258M [00:04<05:03, 841kB/s]
1%|▍ | 3.20M/258M [00:04<05:03, 840kB/s]
1%|▍ | 3.29M/258M [00:04<05:03, 839kB/s]
1%|▌ | 3.37M/258M [00:04<05:10, 820kB/s]
1%|▌ | 3.46M/258M [00:04<05:09, 823kB/s]
1%|▌ | 3.54M/258M [00:04<05:14, 810kB/s]
1%|▌ | 3.62M/258M [00:04<05:12, 815kB/s]
1%|▌ | 3.71M/258M [00:04<05:12, 815kB/s]
1%|▌ | 3.80M/258M [00:04<05:07, 827kB/s]
2%|▌ | 3.89M/258M [00:05<05:02, 841kB/s]
2%|▌ | 3.97M/258M [00:05<05:00, 847kB/s]
2%|▌ | 4.06M/258M [00:05<05:03, 838kB/s]
2%|▋ | 4.14M/258M [00:05<05:10, 818kB/s]
2%|▋ | 4.22M/258M [00:05<05:12, 814kB/s]
2%|▋ | 4.31M/258M [00:05<05:07, 826kB/s]
2%|▋ | 4.40M/258M [00:05<05:08, 824kB/s]
2%|▋ | 4.49M/258M [00:05<05:04, 834kB/s]
2%|▋ | 4.57M/258M [00:05<05:08, 823kB/s]
2%|▋ | 4.66M/258M [00:06<05:10, 817kB/s]
2%|▋ | 4.74M/258M [00:06<05:10, 816kB/s]
2%|▋ | 4.83M/258M [00:06<05:06, 828kB/s]
2%|▋ | 4.92M/258M [00:06<05:04, 832kB/s]
2%|▊ | 5.00M/258M [00:06<05:02, 837kB/s]
2%|▊ | 5.09M/258M [00:06<04:57, 852kB/s]
2%|▊ | 5.18M/258M [00:06<04:57, 851kB/s]
2%|▊ | 5.27M/258M [00:06<04:56, 855kB/s]
2%|▊ | 5.36M/258M [00:06<04:58, 848kB/s]
2%|▊ | 5.45M/258M [00:06<04:54, 858kB/s]
2%|▊ | 5.54M/258M [00:07<04:50, 869kB/s]
2%|▊ | 5.62M/258M [00:07<04:55, 855kB/s]
2%|▊ | 5.72M/258M [00:07<04:49, 871kB/s]
2%|▉ | 5.80M/258M [00:07<04:50, 869kB/s]
2%|▉ | 5.89M/258M [00:07<04:51, 865kB/s]
2%|▉ | 5.99M/258M [00:07<04:46, 881kB/s]
2%|▉ | 6.08M/258M [00:07<04:47, 877kB/s]
2%|▉ | 6.17M/258M [00:07<04:47, 876kB/s]
2%|▉ | 6.26M/258M [00:07<04:45, 882kB/s]
2%|▉ | 6.35M/258M [00:07<04:47, 876kB/s]
2%|▉ | 6.44M/258M [00:08<04:50, 866kB/s]
3%|▉ | 6.53M/258M [00:08<04:53, 857kB/s]
3%|▉ | 6.61M/258M [00:08<04:54, 853kB/s]
3%|█ | 6.70M/258M [00:08<04:52, 859kB/s]
3%|█ | 6.79M/258M [00:08<04:54, 855kB/s]
3%|█ | 6.87M/258M [00:08<04:57, 845kB/s]
3%|█ | 6.96M/258M [00:08<04:58, 842kB/s]
3%|█ | 7.04M/258M [00:08<04:59, 839kB/s]
3%|█ | 7.13M/258M [00:08<05:07, 817kB/s]
3%|█ | 7.21M/258M [00:09<05:03, 826kB/s]
3%|█ | 7.30M/258M [00:09<05:00, 836kB/s]
3%|█ | 7.39M/258M [00:09<04:57, 844kB/s]
3%|█▏ | 7.48M/258M [00:09<04:53, 855kB/s]
3%|█▏ | 7.57M/258M [00:09<04:58, 839kB/s]
3%|█▏ | 7.65M/258M [00:09<05:03, 827kB/s]
3%|█▏ | 7.74M/258M [00:09<04:59, 837kB/s]
3%|█▏ | 7.83M/258M [00:09<04:56, 843kB/s]
3%|█▏ | 7.91M/258M [00:09<04:56, 844kB/s]
3%|█▏ | 8.00M/258M [00:09<04:58, 839kB/s]
3%|█▏ | 8.09M/258M [00:10<04:58, 838kB/s]
3%|█▏ | 8.18M/258M [00:10<04:54, 848kB/s]
3%|█▏ | 8.27M/258M [00:10<04:54, 848kB/s]
3%|█▎ | 8.36M/258M [00:10<04:56, 842kB/s]
3%|█▎ | 8.45M/258M [00:10<04:53, 850kB/s]
3%|█▎ | 8.54M/258M [00:10<04:53, 851kB/s]
3%|█▎ | 8.62M/258M [00:10<05:00, 830kB/s]
3%|█▎ | 8.71M/258M [00:10<05:04, 820kB/s]
3%|█▎ | 8.79M/258M [00:10<05:02, 824kB/s]
3%|█▎ | 8.88M/258M [00:11<04:56, 840kB/s]
3%|█▎ | 8.97M/258M [00:11<04:53, 849kB/s]
4%|█▎ | 9.06M/258M [00:11<04:53, 850kB/s]
4%|█▍ | 9.15M/258M [00:11<04:53, 848kB/s]
4%|█▍ | 9.23M/258M [00:11<04:56, 840kB/s]
4%|█▍ | 9.32M/258M [00:11<04:58, 835kB/s]
4%|█▍ | 9.40M/258M [00:11<05:06, 811kB/s]
4%|█▍ | 9.48M/258M [00:11<05:10, 802kB/s]
4%|█▍ | 9.57M/258M [00:11<05:08, 806kB/s]
4%|█▍ | 9.65M/258M [00:11<05:03, 820kB/s]
4%|█▍ | 9.74M/258M [00:12<05:05, 812kB/s]
4%|█▍ | 9.83M/258M [00:12<05:01, 824kB/s]
4%|█▍ | 9.92M/258M [00:12<04:59, 830kB/s]
4%|█▌ | 10.0M/258M [00:12<04:55, 840kB/s]
4%|█▌ | 10.1M/258M [00:12<05:00, 826kB/s]
4%|█▌ | 10.2M/258M [00:12<04:58, 831kB/s]
4%|█▌ | 10.3M/258M [00:12<04:53, 844kB/s]
4%|█▌ | 10.4M/258M [00:12<04:54, 842kB/s]
4%|█▌ | 10.5M/258M [00:12<04:33, 907kB/s]
4%|█▌ | 10.7M/258M [00:12<03:24, 1.21MB/s]
4%|█▋ | 11.1M/258M [00:13<02:02, 2.03MB/s]
4%|█▋ | 11.4M/258M [00:13<01:48, 2.27MB/s]
5%|█▋ | 11.7M/258M [00:13<01:34, 2.61MB/s]
5%|█▊ | 12.1M/258M [00:13<01:23, 2.94MB/s]
5%|█▊ | 12.5M/258M [00:13<01:11, 3.43MB/s]
5%|█▉ | 13.1M/258M [00:13<00:58, 4.17MB/s]
5%|██ | 13.9M/258M [00:13<00:46, 5.29MB/s]
6%|██▏ | 14.8M/258M [00:13<00:39, 6.22MB/s]
6%|██▎ | 15.8M/258M [00:13<00:33, 7.30MB/s]
6%|██▍ | 16.8M/258M [00:14<00:29, 8.06MB/s]
7%|██▌ | 17.7M/258M [00:14<00:28, 8.43MB/s]
7%|██▊ | 18.8M/258M [00:14<00:26, 8.89MB/s]
8%|██▉ | 19.7M/258M [00:14<00:26, 8.99MB/s]
8%|███ | 20.6M/258M [00:14<00:26, 8.99MB/s]
8%|███▏ | 21.5M/258M [00:14<00:26, 9.09MB/s]
9%|███▎ | 22.5M/258M [00:14<00:26, 8.77MB/s]
9%|███▍ | 23.3M/258M [00:14<00:27, 8.62MB/s]
9%|███▌ | 24.2M/258M [00:14<00:26, 8.67MB/s]
10%|███▋ | 25.1M/258M [00:14<00:27, 8.63MB/s]
10%|███▊ | 26.0M/258M [00:15<00:26, 8.65MB/s]
10%|███▉ | 27.0M/258M [00:15<00:26, 8.89MB/s]
11%|████ | 27.9M/258M [00:15<00:25, 8.93MB/s]
11%|████▏ | 28.8M/258M [00:15<00:26, 8.82MB/s]
11%|████▎ | 29.6M/258M [00:15<00:26, 8.59MB/s]
12%|████▍ | 30.6M/258M [00:15<00:25, 8.77MB/s]
12%|████▋ | 31.5M/258M [00:15<00:25, 8.91MB/s]
13%|████▊ | 32.4M/258M [00:15<00:25, 8.81MB/s]
13%|████▉ | 33.3M/258M [00:15<00:25, 8.80MB/s]
13%|█████ | 34.2M/258M [00:15<00:25, 8.65MB/s]
14%|█████▏ | 35.1M/258M [00:16<00:25, 8.65MB/s]
14%|█████▎ | 36.0M/258M [00:16<00:25, 8.63MB/s]
14%|█████▍ | 36.8M/258M [00:16<00:25, 8.61MB/s]
15%|█████▌ | 37.7M/258M [00:16<00:25, 8.53MB/s]
15%|█████▋ | 38.5M/258M [00:16<00:25, 8.52MB/s]
15%|█████▊ | 39.4M/258M [00:16<00:25, 8.64MB/s]
16%|█████▉ | 40.3M/258M [00:16<00:24, 8.72MB/s]
16%|██████ | 41.2M/258M [00:16<00:25, 8.65MB/s]
16%|██████▏ | 42.1M/258M [00:16<00:25, 8.61MB/s]
17%|██████▎ | 42.9M/258M [00:16<00:25, 8.55MB/s]
17%|██████▍ | 43.8M/258M [00:17<00:25, 8.48MB/s]
17%|██████▌ | 44.7M/258M [00:17<00:24, 8.59MB/s]
18%|██████▋ | 45.6M/258M [00:17<00:25, 8.50MB/s]
18%|██████▊ | 46.5M/258M [00:17<00:24, 8.72MB/s]
18%|██████▉ | 47.4M/258M [00:17<00:24, 8.78MB/s]
19%|███████ | 48.3M/258M [00:17<00:24, 8.50MB/s]
19%|███████▏ | 49.2M/258M [00:17<00:24, 8.64MB/s]
19%|███████▎ | 50.1M/258M [00:17<00:23, 8.76MB/s]
20%|███████▌ | 51.1M/258M [00:17<00:23, 8.96MB/s]
20%|███████▋ | 52.0M/258M [00:18<00:22, 8.98MB/s]
20%|███████▊ | 52.9M/258M [00:18<00:22, 8.94MB/s]
21%|███████▉ | 53.8M/258M [00:18<00:23, 8.74MB/s]
21%|████████ | 54.6M/258M [00:18<00:23, 8.72MB/s]
21%|████████▏ | 55.5M/258M [00:18<00:23, 8.47MB/s]
22%|████████▎ | 56.4M/258M [00:18<00:23, 8.58MB/s]
22%|████████▍ | 57.4M/258M [00:18<00:22, 8.95MB/s]
23%|████████▌ | 58.3M/258M [00:18<00:22, 8.88MB/s]
23%|████████▋ | 59.2M/258M [00:18<00:22, 8.72MB/s]
23%|████████▊ | 60.0M/258M [00:18<00:22, 8.71MB/s]
24%|████████▉ | 60.9M/258M [00:19<00:22, 8.63MB/s]
24%|█████████ | 61.9M/258M [00:19<00:22, 8.77MB/s]
24%|█████████▎ | 63.0M/258M [00:19<00:20, 9.44MB/s]
25%|█████████▍ | 64.1M/258M [00:19<00:19, 9.89MB/s]
25%|█████████▌ | 65.1M/258M [00:19<00:19, 9.95MB/s]
26%|█████████▋ | 66.2M/258M [00:19<00:18, 10.1MB/s]
26%|█████████▉ | 67.2M/258M [00:19<00:19, 9.98MB/s]
26%|██████████ | 68.2M/258M [00:19<00:18, 10.0MB/s]
27%|██████████▏ | 69.2M/258M [00:19<00:19, 9.84MB/s]
27%|██████████▎ | 70.2M/258M [00:19<00:19, 9.79MB/s]
28%|██████████▍ | 71.2M/258M [00:20<00:19, 9.78MB/s]
28%|██████████▌ | 72.2M/258M [00:20<00:19, 9.66MB/s]
28%|██████████▊ | 73.1M/258M [00:20<00:19, 9.47MB/s]
29%|██████████▉ | 74.1M/258M [00:20<00:19, 9.47MB/s]
29%|███████████ | 75.1M/258M [00:20<00:19, 9.54MB/s]
29%|███████████▏ | 76.1M/258M [00:20<00:19, 9.55MB/s]
30%|███████████▎ | 77.1M/258M [00:20<00:19, 9.53MB/s]
30%|███████████▍ | 78.1M/258M [00:20<00:18, 9.50MB/s]
31%|███████████▋ | 79.0M/258M [00:20<00:19, 9.38MB/s]
31%|███████████▊ | 80.0M/258M [00:21<00:18, 9.43MB/s]
31%|███████████▉ | 81.0M/258M [00:21<00:18, 9.51MB/s]
32%|████████████ | 82.0M/258M [00:21<00:18, 9.71MB/s]
32%|████████████▏ | 83.0M/258M [00:21<00:18, 9.70MB/s]
33%|████████████▎ | 84.0M/258M [00:21<00:18, 9.54MB/s]
33%|████████████▌ | 85.0M/258M [00:21<00:18, 9.56MB/s]
33%|████████████▋ | 86.0M/258M [00:21<00:18, 9.55MB/s]
34%|████████████▊ | 86.9M/258M [00:21<00:17, 9.55MB/s]
34%|████████████▉ | 87.9M/258M [00:21<00:17, 9.65MB/s]
34%|█████████████ | 88.9M/258M [00:21<00:17, 9.65MB/s]
35%|█████████████▏ | 89.9M/258M [00:22<00:17, 9.59MB/s]
35%|█████████████▍ | 90.9M/258M [00:22<00:17, 9.48MB/s]
36%|█████████████▌ | 91.8M/258M [00:22<00:17, 9.42MB/s]
36%|█████████████▋ | 92.8M/258M [00:22<00:17, 9.22MB/s]
36%|█████████████▊ | 93.7M/258M [00:22<00:17, 9.20MB/s]
37%|█████████████▉ | 94.8M/258M [00:22<00:16, 9.62MB/s]
37%|██████████████ | 95.9M/258M [00:22<00:16, 9.79MB/s]
38%|██████████████▎ | 96.9M/258M [00:22<00:16, 9.93MB/s]
38%|██████████████▍ | 97.9M/258M [00:22<00:16, 9.77MB/s]
38%|██████████████▌ | 98.9M/258M [00:22<00:16, 9.67MB/s]
39%|██████████████▋ | 99.8M/258M [00:23<00:16, 9.65MB/s]
39%|███████████████▏ | 101M/258M [00:23<00:16, 9.74MB/s]
39%|███████████████▍ | 102M/258M [00:23<00:16, 9.62MB/s]
40%|███████████████▌ | 103M/258M [00:23<00:16, 9.60MB/s]
40%|███████████████▋ | 104M/258M [00:23<00:15, 9.67MB/s]
41%|███████████████▊ | 105M/258M [00:23<00:16, 9.55MB/s]
41%|███████████████▉ | 106M/258M [00:23<00:15, 9.71MB/s]
41%|████████████████ | 107M/258M [00:23<00:15, 9.61MB/s]
42%|████████████████▎ | 108M/258M [00:23<00:15, 9.67MB/s]
42%|████████████████▍ | 109M/258M [00:24<00:15, 9.73MB/s]
43%|████████████████▌ | 110M/258M [00:24<00:14, 10.0MB/s]
43%|████████████████▋ | 111M/258M [00:24<00:15, 9.73MB/s]
43%|████████████████▉ | 112M/258M [00:24<00:15, 9.63MB/s]
44%|█████████████████ | 113M/258M [00:24<00:14, 9.70MB/s]
44%|█████████████████▏ | 114M/258M [00:24<00:14, 9.89MB/s]
44%|█████████████████▎ | 115M/258M [00:24<00:14, 9.71MB/s]
45%|█████████████████▍ | 116M/258M [00:24<00:14, 9.68MB/s]
45%|█████████████████▋ | 117M/258M [00:24<00:14, 9.62MB/s]
46%|█████████████████▊ | 118M/258M [00:24<00:14, 9.56MB/s]
46%|█████████████████▉ | 119M/258M [00:25<00:14, 9.41MB/s]
46%|██████████████████ | 120M/258M [00:25<00:14, 9.51MB/s]
47%|██████████████████▏ | 121M/258M [00:25<00:14, 9.50MB/s]
47%|██████████████████▎ | 122M/258M [00:25<00:14, 9.53MB/s]
47%|██████████████████▌ | 123M/258M [00:25<00:14, 9.40MB/s]
48%|██████████████████▋ | 124M/258M [00:25<00:14, 9.60MB/s]
48%|██████████████████▊ | 125M/258M [00:25<00:13, 9.74MB/s]
49%|██████████████████▉ | 126M/258M [00:25<00:13, 9.79MB/s]
49%|███████████████████▏ | 127M/258M [00:25<00:13, 10.0MB/s]
49%|███████████████████▎ | 128M/258M [00:25<00:13, 9.80MB/s]
50%|███████████████████▍ | 129M/258M [00:26<00:13, 9.76MB/s]
50%|███████████████████▌ | 130M/258M [00:26<00:13, 9.62MB/s]
51%|███████████████████▋ | 131M/258M [00:26<00:13, 9.60MB/s]
51%|███████████████████▉ | 132M/258M [00:26<00:12, 9.75MB/s]
51%|████████████████████ | 133M/258M [00:26<00:12, 9.87MB/s]
52%|████████████████████▏ | 134M/258M [00:26<00:12, 9.70MB/s]
52%|████████████████████▎ | 135M/258M [00:26<00:12, 9.53MB/s]
53%|████████████████████▍ | 136M/258M [00:26<00:12, 9.59MB/s]
53%|████████████████████▋ | 137M/258M [00:26<00:12, 9.74MB/s]
53%|████████████████████▊ | 138M/258M [00:26<00:12, 9.86MB/s]
54%|████████████████████▉ | 139M/258M [00:27<00:12, 9.59MB/s]
54%|█████████████████████ | 140M/258M [00:27<00:12, 9.69MB/s]
54%|█████████████████████▎ | 141M/258M [00:27<00:12, 9.79MB/s]
55%|█████████████████████▍ | 142M/258M [00:27<00:11, 9.96MB/s]
55%|█████████████████████▌ | 143M/258M [00:27<00:11, 9.80MB/s]
56%|█████████████████████▋ | 144M/258M [00:27<00:11, 9.68MB/s]
56%|█████████████████████▊ | 145M/258M [00:27<00:11, 9.68MB/s]
56%|██████████████████████ | 146M/258M [00:27<00:11, 9.75MB/s]
57%|██████████████████████▏ | 147M/258M [00:27<00:11, 9.74MB/s]
57%|██████████████████████▎ | 148M/258M [00:28<00:11, 9.71MB/s]
58%|██████████████████████▍ | 149M/258M [00:28<00:11, 9.88MB/s]
58%|██████████████████████▌ | 150M/258M [00:28<00:11, 9.68MB/s]
58%|██████████████████████▊ | 151M/258M [00:28<00:11, 9.66MB/s]
59%|██████████████████████▉ | 152M/258M [00:28<00:10, 9.93MB/s]
59%|███████████████████████ | 153M/258M [00:28<00:10, 9.80MB/s]
60%|███████████████████████▏ | 154M/258M [00:28<00:10, 9.79MB/s]
60%|███████████████████████▎ | 155M/258M [00:28<00:10, 9.72MB/s]
60%|███████████████████████▌ | 156M/258M [00:28<00:10, 9.54MB/s]
61%|███████████████████████▋ | 157M/258M [00:28<00:10, 9.76MB/s]
61%|███████████████████████▊ | 158M/258M [00:29<00:10, 9.84MB/s]
61%|███████████████████████▉ | 159M/258M [00:29<00:10, 9.73MB/s]
62%|████████████████████████ | 160M/258M [00:29<00:10, 9.73MB/s]
62%|████████████████████████▎ | 161M/258M [00:29<00:09, 10.1MB/s]
63%|████████████████████████▍ | 162M/258M [00:29<00:09, 9.84MB/s]
63%|████████████████████████▌ | 163M/258M [00:29<00:09, 9.75MB/s]
63%|████████████████████████▋ | 164M/258M [00:29<00:09, 9.70MB/s]
64%|████████████████████████▉ | 165M/258M [00:29<00:09, 9.60MB/s]
64%|█████████████████████████ | 166M/258M [00:29<00:09, 9.61MB/s]
65%|█████████████████████████▏ | 167M/258M [00:29<00:09, 9.62MB/s]
65%|█████████████████████████▎ | 168M/258M [00:30<00:09, 9.67MB/s]
65%|█████████████████████████▍ | 169M/258M [00:30<00:09, 9.80MB/s]
66%|█████████████████████████▋ | 170M/258M [00:30<00:09, 9.52MB/s]
66%|█████████████████████████▊ | 171M/258M [00:30<00:08, 9.72MB/s]
67%|█████████████████████████▉ | 172M/258M [00:30<00:08, 9.78MB/s]
67%|██████████████████████████ | 173M/258M [00:30<00:08, 9.88MB/s]
67%|██████████████████████████▏ | 174M/258M [00:30<00:08, 9.84MB/s]
68%|██████████████████████████▍ | 175M/258M [00:30<00:08, 9.76MB/s]
68%|██████████████████████████▌ | 176M/258M [00:30<00:08, 9.77MB/s]
68%|██████████████████████████▋ | 177M/258M [00:31<00:08, 9.62MB/s]
69%|██████████████████████████▊ | 178M/258M [00:31<00:08, 9.67MB/s]
69%|███████████████████████████ | 179M/258M [00:31<00:08, 9.91MB/s]
70%|███████████████████████████▏ | 180M/258M [00:31<00:07, 10.1MB/s]
70%|███████████████████████████▎ | 181M/258M [00:31<00:07, 9.79MB/s]
70%|███████████████████████████▍ | 182M/258M [00:31<00:08, 9.37MB/s]
71%|███████████████████████████▌ | 183M/258M [00:31<00:08, 9.35MB/s]
71%|███████████████████████████▊ | 184M/258M [00:31<00:07, 9.61MB/s]
72%|███████████████████████████▉ | 185M/258M [00:31<00:07, 9.95MB/s]
72%|████████████████████████████ | 186M/258M [00:31<00:07, 9.85MB/s]
72%|████████████████████████████▏ | 187M/258M [00:32<00:07, 9.80MB/s]
73%|████████████████████████████▍ | 188M/258M [00:32<00:07, 9.67MB/s]
73%|████████████████████████████▌ | 189M/258M [00:32<00:07, 9.66MB/s]
74%|████████████████████████████▋ | 190M/258M [00:32<00:06, 9.91MB/s]
74%|████████████████████████████▊ | 191M/258M [00:32<00:06, 9.95MB/s]
74%|█████████████████████████████ | 192M/258M [00:32<00:06, 9.86MB/s]
75%|█████████████████████████████▏ | 193M/258M [00:32<00:06, 9.50MB/s]
75%|█████████████████████████████▎ | 194M/258M [00:32<00:06, 9.61MB/s]
76%|█████████████████████████████▍ | 195M/258M [00:32<00:06, 9.51MB/s]
76%|█████████████████████████████▌ | 196M/258M [00:32<00:06, 9.83MB/s]
76%|█████████████████████████████▊ | 197M/258M [00:33<00:06, 9.93MB/s]
77%|█████████████████████████████▉ | 198M/258M [00:33<00:06, 9.65MB/s]
77%|██████████████████████████████ | 199M/258M [00:33<00:06, 9.68MB/s]
78%|██████████████████████████████▏ | 200M/258M [00:33<00:05, 9.96MB/s]
78%|██████████████████████████████▍ | 201M/258M [00:33<00:05, 10.1MB/s]
78%|██████████████████████████████▌ | 202M/258M [00:33<00:05, 9.89MB/s]
79%|██████████████████████████████▋ | 203M/258M [00:33<00:05, 9.88MB/s]
79%|██████████████████████████████▊ | 204M/258M [00:33<00:05, 9.83MB/s]
79%|██████████████████████████████▉ | 205M/258M [00:33<00:05, 9.74MB/s]
80%|███████████████████████████████▏ | 206M/258M [00:34<00:05, 9.95MB/s]
80%|███████████████████████████████▎ | 207M/258M [00:34<00:05, 9.98MB/s]
81%|███████████████████████████████▍ | 208M/258M [00:34<00:05, 9.85MB/s]
81%|███████████████████████████████▌ | 209M/258M [00:34<00:05, 9.71MB/s]
81%|███████████████████████████████▋ | 210M/258M [00:34<00:04, 9.81MB/s]
82%|███████████████████████████████▉ | 211M/258M [00:34<00:04, 9.64MB/s]
82%|████████████████████████████████ | 212M/258M [00:34<00:04, 9.87MB/s]
83%|████████████████████████████████▏ | 213M/258M [00:34<00:04, 9.78MB/s]
83%|████████████████████████████████▎ | 214M/258M [00:34<00:04, 9.74MB/s]
83%|████████████████████████████████▌ | 215M/258M [00:34<00:04, 9.73MB/s]
84%|████████████████████████████████▋ | 216M/258M [00:35<00:04, 9.70MB/s]
84%|████████████████████████████████▊ | 217M/258M [00:35<00:04, 9.67MB/s]
84%|████████████████████████████████▉ | 218M/258M [00:35<00:04, 9.58MB/s]
85%|█████████████████████████████████ | 219M/258M [00:35<00:04, 9.62MB/s]
85%|█████████████████████████████████▏ | 220M/258M [00:35<00:03, 9.74MB/s]
86%|█████████████████████████████████▍ | 221M/258M [00:35<00:03, 9.93MB/s]
86%|█████████████████████████████████▌ | 222M/258M [00:35<00:03, 9.97MB/s]
86%|█████████████████████████████████▋ | 223M/258M [00:35<00:03, 9.77MB/s]
87%|█████████████████████████████████▊ | 224M/258M [00:35<00:03, 9.59MB/s]
87%|██████████████████████████████████ | 225M/258M [00:35<00:03, 9.69MB/s]
88%|██████████████████████████████████▏ | 226M/258M [00:36<00:03, 9.98MB/s]
88%|██████████████████████████████████▎ | 227M/258M [00:36<00:03, 9.80MB/s]
88%|██████████████████████████████████▍ | 228M/258M [00:36<00:03, 9.88MB/s]
89%|██████████████████████████████████▌ | 229M/258M [00:36<00:02, 9.79MB/s]
89%|██████████████████████████████████▊ | 230M/258M [00:36<00:02, 10.0MB/s]
90%|██████████████████████████████████▉ | 231M/258M [00:36<00:02, 10.1MB/s]
90%|███████████████████████████████████ | 232M/258M [00:36<00:02, 10.1MB/s]
90%|███████████████████████████████████▏ | 233M/258M [00:36<00:02, 9.95MB/s]
91%|███████████████████████████████████▍ | 234M/258M [00:36<00:02, 9.65MB/s]
91%|███████████████████████████████████▌ | 235M/258M [00:36<00:02, 9.72MB/s]
92%|███████████████████████████████████▋ | 236M/258M [00:37<00:02, 9.72MB/s]
92%|███████████████████████████████████▊ | 237M/258M [00:37<00:02, 10.0MB/s]
92%|████████████████████████████████████ | 238M/258M [00:37<00:02, 9.84MB/s]
93%|████████████████████████████████████▏ | 239M/258M [00:37<00:01, 9.71MB/s]
93%|████████████████████████████████████▎ | 240M/258M [00:37<00:01, 9.74MB/s]
94%|████████████████████████████████████▍ | 241M/258M [00:37<00:01, 9.84MB/s]
94%|████████████████████████████████████▌ | 242M/258M [00:37<00:01, 9.82MB/s]
94%|████████████████████████████████████▊ | 243M/258M [00:37<00:01, 10.1MB/s]
95%|████████████████████████████████████▉ | 245M/258M [00:37<00:01, 9.95MB/s]
95%|█████████████████████████████████████ | 246M/258M [00:38<00:01, 9.95MB/s]
95%|█████████████████████████████████████▏ | 247M/258M [00:38<00:01, 9.97MB/s]
96%|█████████████████████████████████████▍ | 248M/258M [00:38<00:01, 9.97MB/s]
96%|█████████████████████████████████████▌ | 249M/258M [00:38<00:00, 9.83MB/s]
97%|█████████████████████████████████████▋ | 250M/258M [00:38<00:00, 9.77MB/s]
97%|█████████████████████████████████████▊ | 250M/258M [00:38<00:00, 9.72MB/s]
97%|█████████████████████████████████████▉ | 251M/258M [00:38<00:00, 9.74MB/s]
98%|██████████████████████████████████████▏| 252M/258M [00:38<00:00, 9.78MB/s]
98%|██████████████████████████████████████▎| 254M/258M [00:38<00:00, 9.72MB/s]
99%|██████████████████████████████████████▍| 255M/258M [00:38<00:00, 9.90MB/s]
99%|██████████████████████████████████████▌| 256M/258M [00:39<00:00, 10.1MB/s]
99%|██████████████████████████████████████▊| 257M/258M [00:39<00:00, 9.79MB/s]
100%|██████████████████████████████████████▉| 258M/258M [00:39<00:00, 9.64MB/s]
0%| | 0.00/258M [00:00<?, ?B/s]
100%|████████████████████████████████████████| 258M/258M [00:00<00:00, 316GB/s]
SHA256 hash of downloaded file: 55af0dc58db6d75825e0dd138f542cbab67cac6bb0e25c907445958830c614cd Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future.
Finished operation in 0:01:58
geometry | aeroway | amenity | building | healthcare | historic | landuse | leisure | military | natural | office | shop | sport | tourism | water | waterway | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
feature_id | ||||||||||||||||
node/31005854 | POINT (20.94595 52.17691) | None | restaurant | None | None | None | None | None | None | None | None | None | None | None | None | None |
node/31156693 | POINT (20.95489 52.27100) | None | None | None | None | None | None | None | None | None | None | bakery | None | None | None | None |
node/31917380 | POINT (21.01451 52.21653) | None | None | None | None | memorial | None | None | None | None | None | None | None | None | None | None |
node/32599714 | POINT (21.01518 52.21904) | None | parking_entrance | None | None | None | None | None | None | None | None | None | None | None | None | None |
node/477366355 | POINT (20.92955 52.34046) | None | restaurant | None | None | None | None | None | None | None | None | None | None | None | None | None |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
way/642924278 | POLYGON ((21.02076 52.21405, 21.02068 52.21401... | None | parking | None | None | None | None | None | None | None | None | None | None | None | None | None |
way/642928875 | POLYGON ((21.04211 52.17704, 21.04212 52.17711... | None | None | apartments | None | None | None | None | None | None | None | None | None | None | None | None |
way/643078227 | POLYGON ((21.01589 52.22871, 21.01591 52.22867... | None | None | retail | None | None | None | None | None | None | None | None | None | None | None | None |
way/643081061 | POLYGON ((21.01640 52.22881, 21.01642 52.22877... | None | None | retail | None | None | None | None | None | None | None | None | None | None | None | None |
way/643390349 | POLYGON ((21.03652 52.17997, 21.03494 52.17946... | None | None | None | None | None | None | None | None | grassland | None | None | None | None | None | None |
314175 rows × 16 columns
Plot features¶
Inspired by prettymaps
clipped_features_gdf = warsaw_features_gdf.clip(warsaw_gdf.geometry.unary_union)
ax = warsaw_gdf.plot(color="lavender", figsize=(16, 16))
# plot water
clipped_features_gdf.dropna(subset=["water", "waterway"], how="all").plot(
ax=ax, color="deepskyblue"
)
# plot greenery
clipped_features_gdf[
clipped_features_gdf["landuse"].isin(
["grass", "orchard", "flowerbed", "forest", "greenfield", "meadow"]
)
].plot(ax=ax, color="mediumseagreen")
# plot buildings
clipped_features_gdf.dropna(subset=["building"], how="all").plot(
ax=ax, color="dimgray", markersize=0.1
)
xmin, ymin, xmax, ymax = warsaw_gdf.total_bounds
ax.set_xlim(xmin, xmax)
ax.set_ylim(ymin, ymax)
ax.set_axis_off()
Download all features from popular tags based on OSMTagInfo in Vienna, Austria¶
popular_tags = get_popular_tags(in_wiki_only=True)
num_keys = len(popular_tags)
f"Unique keys: {num_keys}."
'Unique keys: 332.'
{k: popular_tags[k] for k in list(popular_tags)[:10]}
{'4wd_only': ['yes'], 'LandPro08:reviewed': ['no'], 'abandoned': ['yes'], 'abandoned:railway': ['rail'], 'abutters': ['residential'], 'access': ['agricultural', 'customers', 'delivery', 'designated', 'destination', 'forestry', 'no', 'permissive', 'permit', 'private', 'unknown', 'yes'], 'addr:TW:dataset': ['137998'], 'addr:country': ['CZ'], 'addr:state': ['AZ', 'CA', 'CO', 'CT', 'FL', 'IN', 'KY', 'MD', 'ME', 'NC', 'NJ', 'NY', 'PA', 'TX'], 'admin_level': ['10', '11', '2', '4', '5', '6', '7', '8', '9']}
vienna_center_circle = buffer_geometry(Point(16.37009, 48.20931), meters=1000)
vienna_center_circle_gdf = gpd.GeoDataFrame(
geometry=[vienna_center_circle],
crs=WGS84_CRS,
index=gpd.pd.Index(data=["Vienna"], name=REGIONS_INDEX),
)
loader = OSMPbfLoader()
vienna_features_gdf = loader.load(vienna_center_circle_gdf, popular_tags)
vienna_features_gdf
/opt/hostedtoolcache/Python/3.10.14/x64/lib/python3.10/site-packages/srai/loaders/osm_loaders/osm_pbf_loader.py:128: FutureWarning: Use `convert_geometry_to_geodataframe` instead. Deprecated since 0.8.1 version. features_gdf = pbf_reader.get_features_gdf_from_geometry( Downloading data from 'https://download.geofabrik.de/europe/austria-latest.osm.pbf' to file '/home/runner/work/srai/srai/examples/loaders/files/Geofabrik_austria.osm.pbf'.
0%| | 0.00/748M [00:00<?, ?B/s]
0%| | 8.19k/748M [00:00<4:25:02, 47.0kB/s]
0%| | 36.9k/748M [00:00<1:50:09, 113kB/s]
0%| | 94.2k/748M [00:00<59:57, 208kB/s]
0%| | 209k/748M [00:00<32:56, 378kB/s]
0%| | 434k/748M [00:00<17:55, 695kB/s]
0%| | 889k/748M [00:01<09:24, 1.32MB/s]
0%| | 1.79M/748M [00:01<04:54, 2.53MB/s]
0%|▏ | 2.79M/748M [00:01<03:02, 4.08MB/s]
1%|▏ | 3.81M/748M [00:01<02:16, 5.44MB/s]
1%|▏ | 4.86M/748M [00:01<01:51, 6.69MB/s]
1%|▎ | 6.50M/748M [00:01<01:20, 9.21MB/s]
1%|▍ | 7.66M/748M [00:01<01:15, 9.86MB/s]
1%|▍ | 9.29M/748M [00:01<01:03, 11.6MB/s]
1%|▌ | 10.5M/748M [00:01<01:04, 11.4MB/s]
2%|▌ | 12.0M/748M [00:02<00:59, 12.3MB/s]
2%|▋ | 13.3M/748M [00:02<00:59, 12.4MB/s]
2%|▋ | 14.8M/748M [00:02<00:55, 13.1MB/s]
2%|▊ | 16.1M/748M [00:02<00:55, 13.2MB/s]
2%|▉ | 17.6M/748M [00:02<00:53, 13.6MB/s]
3%|▉ | 19.0M/748M [00:02<00:52, 13.8MB/s]
3%|█ | 20.4M/748M [00:02<00:52, 13.8MB/s]
3%|█ | 21.9M/748M [00:02<00:51, 14.1MB/s]
3%|█▏ | 23.3M/748M [00:02<00:52, 13.8MB/s]
3%|█▎ | 24.9M/748M [00:02<00:50, 14.4MB/s]
4%|█▎ | 26.4M/748M [00:03<00:52, 13.7MB/s]
4%|█▍ | 27.9M/748M [00:03<00:50, 14.2MB/s]
4%|█▍ | 29.3M/748M [00:03<00:52, 13.8MB/s]
4%|█▌ | 30.8M/748M [00:03<00:50, 14.2MB/s]
4%|█▋ | 32.3M/748M [00:03<00:50, 14.1MB/s]
5%|█▋ | 33.7M/748M [00:03<00:50, 14.2MB/s]
5%|█▊ | 35.1M/748M [00:03<00:50, 14.2MB/s]
5%|█▊ | 36.6M/748M [00:03<00:50, 14.2MB/s]
5%|█▉ | 38.0M/748M [00:03<00:49, 14.2MB/s]
5%|██ | 39.5M/748M [00:04<00:49, 14.3MB/s]
5%|██ | 40.9M/748M [00:04<00:49, 14.3MB/s]
6%|██▏ | 42.4M/748M [00:04<00:48, 14.4MB/s]
6%|██▏ | 43.8M/748M [00:04<00:49, 14.4MB/s]
6%|██▎ | 45.3M/748M [00:04<00:48, 14.4MB/s]
6%|██▎ | 46.7M/748M [00:04<00:48, 14.3MB/s]
6%|██▍ | 48.2M/748M [00:04<00:48, 14.5MB/s]
7%|██▌ | 49.7M/748M [00:04<00:49, 14.2MB/s]
7%|██▌ | 51.2M/748M [00:04<00:48, 14.4MB/s]
7%|██▋ | 52.6M/748M [00:04<00:49, 14.1MB/s]
7%|██▋ | 54.1M/748M [00:05<00:48, 14.3MB/s]
7%|██▊ | 55.5M/748M [00:05<00:49, 13.9MB/s]
8%|██▉ | 57.0M/748M [00:05<00:49, 14.1MB/s]
8%|██▉ | 58.4M/748M [00:05<00:48, 14.2MB/s]
8%|███ | 59.9M/748M [00:05<00:48, 14.2MB/s]
8%|███ | 61.3M/748M [00:05<00:48, 14.3MB/s]
8%|███▏ | 62.8M/748M [00:05<00:47, 14.3MB/s]
9%|███▎ | 64.2M/748M [00:05<00:47, 14.5MB/s]
9%|███▎ | 65.7M/748M [00:05<00:47, 14.4MB/s]
9%|███▍ | 67.1M/748M [00:05<00:47, 14.4MB/s]
9%|███▍ | 68.6M/748M [00:06<00:48, 14.0MB/s]
9%|███▌ | 70.0M/748M [00:06<00:48, 14.1MB/s]
10%|███▋ | 71.5M/748M [00:06<00:47, 14.2MB/s]
10%|███▋ | 72.9M/748M [00:06<00:48, 14.0MB/s]
10%|███▊ | 74.4M/748M [00:06<00:47, 14.3MB/s]
10%|███▊ | 75.8M/748M [00:06<00:47, 14.1MB/s]
10%|███▉ | 77.2M/748M [00:06<00:47, 14.0MB/s]
11%|███▉ | 78.7M/748M [00:06<00:46, 14.3MB/s]
11%|████ | 80.2M/748M [00:06<00:47, 14.2MB/s]
11%|████▏ | 81.6M/748M [00:06<00:46, 14.2MB/s]
11%|████▏ | 83.1M/748M [00:07<00:46, 14.4MB/s]
11%|████▎ | 84.5M/748M [00:07<00:46, 14.2MB/s]
11%|████▎ | 86.0M/748M [00:07<00:46, 14.3MB/s]
12%|████▍ | 87.4M/748M [00:07<00:46, 14.3MB/s]
12%|████▌ | 88.9M/748M [00:07<00:45, 14.4MB/s]
12%|████▌ | 90.4M/748M [00:07<00:45, 14.4MB/s]
12%|████▋ | 91.8M/748M [00:07<00:45, 14.3MB/s]
12%|████▋ | 93.3M/748M [00:07<00:45, 14.4MB/s]
13%|████▊ | 94.7M/748M [00:07<00:45, 14.5MB/s]
13%|████▉ | 96.2M/748M [00:07<00:45, 14.2MB/s]
13%|████▉ | 97.6M/748M [00:08<01:04, 10.1MB/s]
13%|█████ | 99.5M/748M [00:08<00:54, 11.9MB/s]
13%|█████▎ | 101M/748M [00:08<00:58, 11.0MB/s]
14%|█████▎ | 102M/748M [00:08<00:54, 11.7MB/s]
14%|█████▍ | 104M/748M [00:08<00:51, 12.4MB/s]
14%|█████▍ | 105M/748M [00:08<00:51, 12.6MB/s]
14%|█████▌ | 106M/748M [00:08<00:49, 12.9MB/s]
14%|█████▌ | 108M/748M [00:08<00:48, 13.3MB/s]
15%|█████▋ | 109M/748M [00:09<00:47, 13.5MB/s]
15%|█████▊ | 111M/748M [00:09<00:45, 13.9MB/s]
15%|█████▊ | 112M/748M [00:09<00:46, 13.7MB/s]
15%|█████▉ | 114M/748M [00:09<00:46, 13.5MB/s]
15%|█████▉ | 115M/748M [00:09<00:48, 13.1MB/s]
16%|██████ | 116M/748M [00:09<00:47, 13.3MB/s]
16%|██████▏ | 118M/748M [00:09<00:46, 13.5MB/s]
16%|██████▏ | 119M/748M [00:09<00:45, 13.7MB/s]
16%|██████▎ | 121M/748M [00:09<00:46, 13.5MB/s]
16%|██████▎ | 122M/748M [00:10<00:46, 13.6MB/s]
16%|██████▍ | 123M/748M [00:10<00:46, 13.5MB/s]
17%|██████▌ | 125M/748M [00:10<00:45, 13.6MB/s]
17%|██████▌ | 126M/748M [00:10<00:44, 13.8MB/s]
17%|██████▋ | 128M/748M [00:10<00:45, 13.7MB/s]
17%|██████▋ | 129M/748M [00:10<00:44, 14.0MB/s]
17%|██████▊ | 130M/748M [00:10<00:45, 13.7MB/s]
18%|██████▊ | 132M/748M [00:10<00:44, 13.9MB/s]
18%|██████▉ | 133M/748M [00:10<00:44, 13.8MB/s]
18%|███████ | 135M/748M [00:10<00:44, 13.9MB/s]
18%|███████ | 136M/748M [00:11<00:43, 14.1MB/s]
18%|███████▏ | 138M/748M [00:11<00:43, 14.0MB/s]
19%|███████▏ | 139M/748M [00:11<00:43, 14.0MB/s]
19%|███████▎ | 140M/748M [00:11<00:45, 13.5MB/s]
19%|███████▍ | 142M/748M [00:11<00:44, 13.6MB/s]
19%|███████▍ | 143M/748M [00:11<00:44, 13.7MB/s]
19%|███████▌ | 145M/748M [00:11<00:43, 13.8MB/s]
20%|███████▌ | 146M/748M [00:11<00:42, 14.2MB/s]
20%|███████▋ | 147M/748M [00:11<00:44, 13.6MB/s]
20%|███████▊ | 149M/748M [00:11<00:44, 13.6MB/s]
20%|███████▊ | 150M/748M [00:12<00:44, 13.5MB/s]
20%|███████▉ | 152M/748M [00:12<00:44, 13.3MB/s]
20%|███████▉ | 153M/748M [00:12<00:44, 13.5MB/s]
21%|████████ | 154M/748M [00:12<00:43, 13.7MB/s]
21%|████████ | 156M/748M [00:12<00:44, 13.2MB/s]
21%|████████▏ | 157M/748M [00:12<00:47, 12.6MB/s]
21%|████████▎ | 158M/748M [00:12<00:49, 11.8MB/s]
21%|████████▎ | 159M/748M [00:12<00:51, 11.5MB/s]
21%|████████▍ | 161M/748M [00:12<00:51, 11.3MB/s]
22%|████████▍ | 162M/748M [00:13<00:52, 11.2MB/s]
22%|████████▍ | 163M/748M [00:13<00:52, 11.1MB/s]
22%|████████▌ | 164M/748M [00:13<00:53, 10.9MB/s]
22%|████████▌ | 165M/748M [00:13<00:54, 10.7MB/s]
22%|████████▋ | 166M/748M [00:13<00:54, 10.7MB/s]
22%|████████▋ | 167M/748M [00:13<00:54, 10.7MB/s]
23%|████████▊ | 168M/748M [00:13<00:55, 10.5MB/s]
23%|████████▊ | 169M/748M [00:13<00:56, 10.3MB/s]
23%|████████▉ | 170M/748M [00:13<00:55, 10.4MB/s]
23%|████████▉ | 171M/748M [00:13<00:57, 10.1MB/s]
23%|████████▉ | 172M/748M [00:14<00:57, 9.93MB/s]
23%|█████████ | 174M/748M [00:14<00:56, 10.1MB/s]
23%|█████████ | 175M/748M [00:14<00:57, 10.0MB/s]
23%|█████████▏ | 176M/748M [00:14<00:56, 10.1MB/s]
24%|█████████▏ | 177M/748M [00:14<00:55, 10.2MB/s]
24%|█████████▎ | 178M/748M [00:14<00:56, 10.1MB/s]
24%|█████████▎ | 179M/748M [00:14<00:55, 10.3MB/s]
24%|█████████▎ | 180M/748M [00:14<00:55, 10.2MB/s]
24%|█████████▍ | 181M/748M [00:14<00:55, 10.3MB/s]
24%|█████████▍ | 182M/748M [00:15<00:55, 10.2MB/s]
24%|█████████▌ | 183M/748M [00:15<00:56, 10.1MB/s]
25%|█████████▌ | 184M/748M [00:15<00:56, 10.0MB/s]
25%|█████████▋ | 185M/748M [00:15<00:56, 9.92MB/s]
25%|█████████▋ | 186M/748M [00:15<00:56, 10.0MB/s]
25%|█████████▋ | 187M/748M [00:15<00:56, 10.0MB/s]
25%|█████████▊ | 188M/748M [00:15<00:56, 9.86MB/s]
25%|█████████▊ | 189M/748M [00:15<00:56, 9.95MB/s]
25%|█████████▉ | 190M/748M [00:15<00:56, 9.85MB/s]
26%|█████████▉ | 191M/748M [00:15<00:56, 9.90MB/s]
26%|██████████ | 192M/748M [00:16<00:56, 9.77MB/s]
26%|██████████ | 193M/748M [00:16<00:57, 9.71MB/s]
26%|██████████ | 194M/748M [00:16<00:57, 9.70MB/s]
26%|██████████▏ | 195M/748M [00:16<00:57, 9.61MB/s]
26%|██████████▏ | 196M/748M [00:16<00:55, 9.92MB/s]
26%|██████████▎ | 197M/748M [00:16<00:55, 9.87MB/s]
26%|██████████▎ | 198M/748M [00:16<00:57, 9.59MB/s]
27%|██████████▎ | 199M/748M [00:16<00:58, 9.42MB/s]
27%|██████████▍ | 200M/748M [00:16<00:57, 9.60MB/s]
27%|██████████▍ | 201M/748M [00:16<00:54, 10.0MB/s]
27%|██████████▌ | 202M/748M [00:17<00:53, 10.1MB/s]
27%|██████████▌ | 203M/748M [00:17<00:54, 10.0MB/s]
27%|██████████▋ | 204M/748M [00:17<00:49, 10.9MB/s]
27%|██████████▋ | 205M/748M [00:17<00:49, 11.0MB/s]
28%|██████████▊ | 207M/748M [00:17<00:49, 10.9MB/s]
28%|██████████▊ | 208M/748M [00:17<00:48, 11.1MB/s]
28%|██████████▉ | 209M/748M [00:17<00:48, 11.2MB/s]
28%|██████████▉ | 210M/748M [00:17<00:48, 11.1MB/s]
28%|███████████ | 211M/748M [00:17<00:47, 11.2MB/s]
28%|███████████ | 212M/748M [00:17<00:47, 11.3MB/s]
29%|███████████ | 213M/748M [00:18<00:48, 10.9MB/s]
29%|███████████▏ | 215M/748M [00:18<00:47, 11.2MB/s]
29%|███████████▏ | 216M/748M [00:18<00:47, 11.3MB/s]
29%|███████████▎ | 217M/748M [00:18<00:47, 11.3MB/s]
29%|███████████▎ | 218M/748M [00:18<00:46, 11.4MB/s]
29%|███████████▍ | 219M/748M [00:18<00:46, 11.3MB/s]
29%|███████████▍ | 220M/748M [00:18<00:47, 11.2MB/s]
30%|███████████▌ | 221M/748M [00:18<00:46, 11.4MB/s]
30%|███████████▌ | 223M/748M [00:18<00:46, 11.4MB/s]
30%|███████████▋ | 224M/748M [00:18<00:44, 11.7MB/s]
30%|███████████▋ | 225M/748M [00:19<00:45, 11.6MB/s]
30%|███████████▊ | 226M/748M [00:19<00:45, 11.4MB/s]
30%|███████████▊ | 227M/748M [00:19<00:45, 11.4MB/s]
31%|███████████▉ | 228M/748M [00:19<00:46, 11.2MB/s]
31%|███████████▉ | 230M/748M [00:19<00:46, 11.2MB/s]
31%|████████████ | 231M/748M [00:19<00:45, 11.3MB/s]
31%|████████████ | 232M/748M [00:19<00:46, 11.1MB/s]
31%|████████████▏ | 233M/748M [00:19<00:46, 11.0MB/s]
31%|████████████▏ | 234M/748M [00:19<00:47, 10.8MB/s]
31%|████████████▎ | 235M/748M [00:20<00:47, 10.9MB/s]
32%|████████████▎ | 236M/748M [00:20<00:47, 10.7MB/s]
32%|████████████▍ | 238M/748M [00:20<00:46, 11.0MB/s]
32%|████████████▍ | 239M/748M [00:20<00:45, 11.2MB/s]
32%|████████████▌ | 240M/748M [00:20<00:45, 11.1MB/s]
32%|████████████▌ | 241M/748M [00:20<00:46, 11.0MB/s]
32%|████████████▌ | 242M/748M [00:20<00:45, 11.1MB/s]
33%|████████████▋ | 243M/748M [00:20<00:45, 11.0MB/s]
33%|████████████▋ | 244M/748M [00:20<00:45, 11.1MB/s]
33%|████████████▊ | 245M/748M [00:20<00:45, 11.1MB/s]
33%|████████████▊ | 247M/748M [00:21<00:44, 11.3MB/s]
33%|████████████▉ | 248M/748M [00:21<00:44, 11.3MB/s]
33%|████████████▉ | 249M/748M [00:21<00:44, 11.1MB/s]
33%|█████████████ | 250M/748M [00:21<00:45, 10.9MB/s]
34%|█████████████ | 251M/748M [00:21<00:45, 11.0MB/s]
34%|█████████████▏ | 252M/748M [00:21<00:44, 11.2MB/s]
34%|█████████████▏ | 254M/748M [00:21<00:42, 11.7MB/s]
34%|█████████████▎ | 255M/748M [00:21<00:42, 11.6MB/s]
34%|█████████████▎ | 256M/748M [00:21<00:41, 11.8MB/s]
34%|█████████████▍ | 257M/748M [00:21<00:41, 11.8MB/s]
35%|█████████████▍ | 258M/748M [00:22<00:41, 11.7MB/s]
35%|█████████████▌ | 260M/748M [00:22<00:42, 11.5MB/s]
35%|█████████████▌ | 261M/748M [00:22<00:42, 11.4MB/s]
35%|█████████████▋ | 262M/748M [00:22<00:41, 11.8MB/s]
35%|█████████████▋ | 263M/748M [00:22<00:41, 11.8MB/s]
35%|█████████████▊ | 264M/748M [00:22<00:40, 11.8MB/s]
36%|█████████████▊ | 266M/748M [00:22<00:39, 12.2MB/s]
36%|█████████████▉ | 267M/748M [00:22<00:38, 12.4MB/s]
36%|█████████████▉ | 268M/748M [00:22<00:38, 12.4MB/s]
36%|██████████████ | 269M/748M [00:22<00:38, 12.3MB/s]
36%|██████████████ | 271M/748M [00:23<00:39, 12.1MB/s]
36%|██████████████▏ | 272M/748M [00:23<00:38, 12.3MB/s]
37%|██████████████▏ | 273M/748M [00:23<00:38, 12.3MB/s]
37%|██████████████▎ | 274M/748M [00:23<00:38, 12.3MB/s]
37%|██████████████▎ | 276M/748M [00:23<00:38, 12.1MB/s]
37%|██████████████▍ | 277M/748M [00:23<00:37, 12.4MB/s]
37%|██████████████▌ | 278M/748M [00:23<00:37, 12.4MB/s]
37%|██████████████▌ | 279M/748M [00:23<00:38, 12.3MB/s]
38%|██████████████▋ | 281M/748M [00:23<00:37, 12.5MB/s]
38%|██████████████▋ | 282M/748M [00:24<00:38, 12.2MB/s]
38%|██████████████▊ | 283M/748M [00:24<00:37, 12.3MB/s]
38%|██████████████▊ | 285M/748M [00:24<00:38, 12.1MB/s]
38%|██████████████▉ | 286M/748M [00:24<00:38, 12.1MB/s]
38%|██████████████▉ | 287M/748M [00:24<00:38, 12.0MB/s]
39%|███████████████ | 288M/748M [00:24<00:37, 12.1MB/s]
39%|███████████████ | 289M/748M [00:24<00:37, 12.3MB/s]
39%|███████████████▏ | 291M/748M [00:24<00:35, 12.8MB/s]
39%|███████████████▏ | 292M/748M [00:24<00:35, 12.8MB/s]
39%|███████████████▎ | 293M/748M [00:24<00:37, 12.2MB/s]
39%|███████████████▎ | 295M/748M [00:25<00:38, 11.8MB/s]
40%|███████████████▍ | 296M/748M [00:25<00:39, 11.3MB/s]
40%|███████████████▍ | 297M/748M [00:25<00:38, 11.7MB/s]
40%|███████████████▌ | 298M/748M [00:25<00:38, 11.7MB/s]
40%|███████████████▌ | 299M/748M [00:25<00:38, 11.6MB/s]
40%|███████████████▋ | 301M/748M [00:25<00:39, 11.4MB/s]
40%|███████████████▋ | 302M/748M [00:25<00:39, 11.2MB/s]
40%|███████████████▊ | 303M/748M [00:25<00:38, 11.4MB/s]
41%|███████████████▊ | 304M/748M [00:25<00:38, 11.6MB/s]
41%|███████████████▉ | 305M/748M [00:25<00:38, 11.6MB/s]
41%|███████████████▉ | 306M/748M [00:26<00:38, 11.5MB/s]
41%|████████████████ | 308M/748M [00:26<00:38, 11.5MB/s]
41%|████████████████ | 309M/748M [00:26<00:38, 11.4MB/s]
41%|████████████████▏ | 310M/748M [00:26<00:38, 11.3MB/s]
42%|████████████████▏ | 311M/748M [00:26<00:38, 11.4MB/s]
42%|████████████████▎ | 312M/748M [00:26<00:38, 11.2MB/s]
42%|████████████████▎ | 314M/748M [00:26<00:37, 11.7MB/s]
42%|████████████████▍ | 315M/748M [00:26<00:37, 11.5MB/s]
42%|████████████████▍ | 316M/748M [00:26<00:38, 11.3MB/s]
42%|████████████████▌ | 317M/748M [00:27<00:38, 11.1MB/s]
43%|████████████████▌ | 318M/748M [00:27<00:39, 11.0MB/s]
43%|████████████████▋ | 319M/748M [00:27<00:37, 11.6MB/s]
43%|████████████████▋ | 321M/748M [00:27<00:36, 11.8MB/s]
43%|████████████████▊ | 322M/748M [00:27<00:36, 11.7MB/s]
43%|████████████████▊ | 323M/748M [00:27<00:37, 11.3MB/s]
43%|████████████████▉ | 324M/748M [00:27<00:37, 11.3MB/s]
43%|████████████████▉ | 325M/748M [00:27<00:37, 11.3MB/s]
44%|█████████████████ | 327M/748M [00:27<00:37, 11.4MB/s]
44%|█████████████████ | 328M/748M [00:27<00:36, 11.6MB/s]
44%|█████████████████▏ | 329M/748M [00:28<00:36, 11.5MB/s]
44%|█████████████████▏ | 330M/748M [00:28<00:35, 11.9MB/s]
44%|█████████████████▎ | 331M/748M [00:28<00:35, 11.8MB/s]
44%|█████████████████▎ | 333M/748M [00:28<00:35, 11.8MB/s]
45%|█████████████████▍ | 334M/748M [00:28<00:33, 12.5MB/s]
45%|█████████████████▍ | 335M/748M [00:28<00:31, 13.0MB/s]
45%|█████████████████▌ | 337M/748M [00:28<00:31, 12.9MB/s]
45%|█████████████████▋ | 338M/748M [00:28<00:30, 13.4MB/s]
45%|█████████████████▋ | 340M/748M [00:28<00:30, 13.2MB/s]
46%|█████████████████▊ | 341M/748M [00:28<00:31, 13.0MB/s]
46%|█████████████████▊ | 342M/748M [00:29<00:31, 12.9MB/s]
46%|█████████████████▉ | 344M/748M [00:29<00:30, 13.1MB/s]
46%|█████████████████▉ | 345M/748M [00:29<00:29, 13.5MB/s]
46%|██████████████████ | 346M/748M [00:29<00:30, 13.3MB/s]
46%|██████████████████▏ | 348M/748M [00:29<00:29, 13.5MB/s]
47%|██████████████████▏ | 349M/748M [00:29<00:30, 13.3MB/s]
47%|██████████████████▎ | 350M/748M [00:29<00:29, 13.4MB/s]
47%|██████████████████▎ | 352M/748M [00:29<00:29, 13.5MB/s]
47%|██████████████████▍ | 353M/748M [00:29<00:29, 13.2MB/s]
47%|██████████████████▍ | 354M/748M [00:29<00:30, 12.9MB/s]
48%|██████████████████▌ | 356M/748M [00:30<00:30, 13.0MB/s]
48%|██████████████████▌ | 357M/748M [00:30<00:31, 12.6MB/s]
48%|██████████████████▋ | 359M/748M [00:30<00:29, 13.1MB/s]
48%|██████████████████▊ | 360M/748M [00:30<00:29, 13.3MB/s]
48%|██████████████████▊ | 361M/748M [00:30<00:29, 13.3MB/s]
48%|██████████████████▉ | 363M/748M [00:30<00:28, 13.8MB/s]
49%|██████████████████▉ | 364M/748M [00:30<00:29, 13.2MB/s]
49%|███████████████████ | 366M/748M [00:30<00:28, 13.5MB/s]
49%|███████████████████▏ | 367M/748M [00:30<00:28, 13.6MB/s]
49%|███████████████████▏ | 368M/748M [00:31<00:28, 13.3MB/s]
49%|███████████████████▎ | 370M/748M [00:31<00:27, 13.7MB/s]
50%|███████████████████▎ | 371M/748M [00:31<00:27, 13.6MB/s]
50%|███████████████████▍ | 372M/748M [00:31<00:28, 13.2MB/s]
50%|███████████████████▍ | 374M/748M [00:31<00:28, 13.1MB/s]
50%|███████████████████▌ | 375M/748M [00:31<00:28, 13.2MB/s]
50%|███████████████████▋ | 377M/748M [00:31<00:28, 13.3MB/s]
51%|███████████████████▋ | 378M/748M [00:31<00:28, 13.0MB/s]
51%|███████████████████▊ | 379M/748M [00:31<00:28, 12.8MB/s]
51%|███████████████████▊ | 380M/748M [00:31<00:29, 12.6MB/s]
51%|███████████████████▉ | 382M/748M [00:32<00:28, 13.0MB/s]
51%|███████████████████▉ | 383M/748M [00:32<00:27, 13.4MB/s]
51%|████████████████████ | 385M/748M [00:32<00:26, 13.8MB/s]
52%|████████████████████▏ | 386M/748M [00:32<00:26, 13.7MB/s]
52%|████████████████████▏ | 388M/748M [00:32<00:26, 13.9MB/s]
52%|████████████████████▎ | 389M/748M [00:32<00:26, 13.7MB/s]
52%|████████████████████▎ | 390M/748M [00:32<00:25, 13.9MB/s]
52%|████████████████████▍ | 392M/748M [00:32<00:25, 13.7MB/s]
53%|████████████████████▍ | 393M/748M [00:32<00:25, 13.8MB/s]
53%|████████████████████▌ | 395M/748M [00:32<00:26, 13.4MB/s]
53%|████████████████████▋ | 396M/748M [00:33<00:25, 13.6MB/s]
53%|████████████████████▋ | 397M/748M [00:33<00:25, 13.6MB/s]
53%|████████████████████▊ | 399M/748M [00:33<00:26, 13.2MB/s]
53%|████████████████████▊ | 400M/748M [00:33<00:29, 11.8MB/s]
54%|████████████████████▉ | 401M/748M [00:33<00:31, 11.1MB/s]
54%|████████████████████▉ | 402M/748M [00:33<00:31, 10.8MB/s]
54%|█████████████████████ | 403M/748M [00:33<00:32, 10.5MB/s]
54%|█████████████████████ | 405M/748M [00:33<00:33, 10.4MB/s]
54%|█████████████████████▏ | 406M/748M [00:33<00:33, 10.3MB/s]
54%|█████████████████████▏ | 407M/748M [00:34<00:32, 10.5MB/s]
55%|█████████████████████▎ | 408M/748M [00:34<00:32, 10.4MB/s]
55%|█████████████████████▎ | 409M/748M [00:34<00:30, 11.3MB/s]
55%|█████████████████████▍ | 411M/748M [00:34<00:27, 12.1MB/s]
55%|█████████████████████▍ | 412M/748M [00:34<00:27, 12.3MB/s]
55%|█████████████████████▌ | 413M/748M [00:34<00:26, 12.7MB/s]
55%|█████████████████████▌ | 415M/748M [00:34<00:25, 13.0MB/s]
56%|█████████████████████▋ | 416M/748M [00:34<00:25, 13.2MB/s]
56%|█████████████████████▊ | 417M/748M [00:34<00:24, 13.7MB/s]
56%|█████████████████████▊ | 419M/748M [00:35<00:24, 13.6MB/s]
56%|█████████████████████▉ | 420M/748M [00:35<00:23, 13.9MB/s]
56%|█████████████████████▉ | 422M/748M [00:35<00:23, 14.0MB/s]
57%|██████████████████████ | 423M/748M [00:35<00:23, 13.9MB/s]
57%|██████████████████████▏ | 424M/748M [00:35<00:23, 13.9MB/s]
57%|██████████████████████▏ | 426M/748M [00:35<00:22, 14.1MB/s]
57%|██████████████████████▎ | 427M/748M [00:35<00:23, 13.6MB/s]
57%|██████████████████████▎ | 429M/748M [00:35<00:25, 12.4MB/s]
57%|██████████████████████▍ | 430M/748M [00:35<00:27, 11.4MB/s]
58%|██████████████████████▍ | 431M/748M [00:36<00:29, 10.8MB/s]
58%|██████████████████████▌ | 432M/748M [00:36<00:30, 10.4MB/s]
58%|██████████████████████▌ | 433M/748M [00:36<00:31, 10.2MB/s]
58%|██████████████████████▋ | 434M/748M [00:36<00:31, 10.0MB/s]
58%|██████████████████████▋ | 435M/748M [00:36<00:31, 9.90MB/s]
58%|██████████████████████▋ | 436M/748M [00:36<00:31, 9.89MB/s]
58%|██████████████████████▊ | 437M/748M [00:36<00:31, 9.84MB/s]
59%|██████████████████████▊ | 438M/748M [00:36<00:31, 9.82MB/s]
59%|██████████████████████▉ | 439M/748M [00:36<00:31, 9.86MB/s]
59%|██████████████████████▉ | 440M/748M [00:36<00:31, 9.83MB/s]
59%|███████████████████████ | 441M/748M [00:37<00:31, 9.79MB/s]
59%|███████████████████████ | 442M/748M [00:37<00:31, 9.79MB/s]
59%|███████████████████████ | 443M/748M [00:37<00:31, 9.76MB/s]
59%|███████████████████████▏ | 444M/748M [00:37<00:31, 9.75MB/s]
60%|███████████████████████▏ | 445M/748M [00:37<00:31, 9.69MB/s]
60%|███████████████████████▎ | 446M/748M [00:37<00:31, 9.70MB/s]
60%|███████████████████████▎ | 447M/748M [00:37<00:31, 9.68MB/s]
60%|███████████████████████▎ | 448M/748M [00:37<00:31, 9.66MB/s]
60%|███████████████████████▍ | 449M/748M [00:37<00:30, 9.70MB/s]
60%|███████████████████████▍ | 450M/748M [00:37<00:30, 9.74MB/s]
60%|███████████████████████▌ | 451M/748M [00:38<00:30, 9.69MB/s]
60%|███████████████████████▌ | 452M/748M [00:38<00:30, 9.66MB/s]
61%|███████████████████████▌ | 453M/748M [00:38<00:30, 9.71MB/s]
61%|███████████████████████▋ | 454M/748M [00:38<00:30, 9.67MB/s]
61%|███████████████████████▋ | 455M/748M [00:38<00:30, 9.71MB/s]
61%|███████████████████████▊ | 456M/748M [00:38<00:29, 9.75MB/s]
61%|███████████████████████▊ | 457M/748M [00:38<00:29, 9.81MB/s]
61%|███████████████████████▉ | 458M/748M [00:38<00:26, 10.8MB/s]
61%|███████████████████████▉ | 460M/748M [00:38<00:24, 11.8MB/s]
62%|████████████████████████ | 461M/748M [00:38<00:23, 12.2MB/s]
62%|████████████████████████ | 463M/748M [00:39<00:22, 12.9MB/s]
62%|████████████████████████▏ | 464M/748M [00:39<00:21, 13.1MB/s]
62%|████████████████████████▎ | 465M/748M [00:39<00:21, 13.4MB/s]
62%|████████████████████████▎ | 467M/748M [00:39<00:20, 13.6MB/s]
63%|████████████████████████▍ | 468M/748M [00:39<00:20, 13.8MB/s]
63%|████████████████████████▍ | 470M/748M [00:39<00:20, 13.9MB/s]
63%|████████████████████████▌ | 471M/748M [00:39<00:19, 13.9MB/s]
63%|████████████████████████▋ | 472M/748M [00:39<00:19, 13.8MB/s]
63%|████████████████████████▋ | 474M/748M [00:39<00:19, 13.9MB/s]
64%|████████████████████████▊ | 475M/748M [00:39<00:19, 13.9MB/s]
64%|████████████████████████▊ | 477M/748M [00:40<00:19, 14.0MB/s]
64%|████████████████████████▉ | 478M/748M [00:40<00:19, 13.9MB/s]
64%|████████████████████████▉ | 479M/748M [00:40<00:19, 13.9MB/s]
64%|█████████████████████████ | 481M/748M [00:40<00:19, 13.9MB/s]
64%|█████████████████████████▏ | 482M/748M [00:40<00:18, 14.0MB/s]
65%|█████████████████████████▏ | 484M/748M [00:40<00:19, 13.8MB/s]
65%|█████████████████████████▎ | 485M/748M [00:40<00:18, 13.8MB/s]
65%|█████████████████████████▎ | 486M/748M [00:40<00:19, 13.7MB/s]
65%|█████████████████████████▍ | 488M/748M [00:40<00:18, 14.0MB/s]
65%|█████████████████████████▌ | 489M/748M [00:41<00:18, 14.1MB/s]
66%|█████████████████████████▌ | 491M/748M [00:41<00:18, 14.1MB/s]
66%|█████████████████████████▋ | 492M/748M [00:41<00:18, 14.2MB/s]
66%|█████████████████████████▋ | 494M/748M [00:41<00:17, 14.2MB/s]
66%|█████████████████████████▊ | 495M/748M [00:41<00:17, 14.2MB/s]
66%|█████████████████████████▉ | 497M/748M [00:41<00:17, 14.2MB/s]
67%|█████████████████████████▉ | 498M/748M [00:41<00:17, 14.4MB/s]
67%|██████████████████████████ | 499M/748M [00:41<00:17, 14.2MB/s]
67%|██████████████████████████ | 501M/748M [00:41<00:17, 14.3MB/s]
67%|██████████████████████████▏ | 502M/748M [00:41<00:17, 14.2MB/s]
67%|██████████████████████████▎ | 504M/748M [00:42<00:17, 14.3MB/s]
68%|██████████████████████████▎ | 505M/748M [00:42<00:17, 14.2MB/s]
68%|██████████████████████████▍ | 507M/748M [00:42<00:16, 14.3MB/s]
68%|██████████████████████████▍ | 508M/748M [00:42<00:16, 14.2MB/s]
68%|██████████████████████████▌ | 510M/748M [00:42<00:16, 14.4MB/s]
68%|██████████████████████████▋ | 511M/748M [00:42<00:16, 14.3MB/s]
69%|██████████████████████████▋ | 512M/748M [00:42<00:16, 14.3MB/s]
69%|██████████████████████████▊ | 514M/748M [00:42<00:16, 14.2MB/s]
69%|██████████████████████████▊ | 515M/748M [00:42<00:16, 14.3MB/s]
69%|██████████████████████████▉ | 517M/748M [00:42<00:16, 14.1MB/s]
69%|███████████████████████████ | 518M/748M [00:43<00:16, 14.2MB/s]
69%|███████████████████████████ | 520M/748M [00:43<00:16, 14.2MB/s]
70%|███████████████████████████▏ | 521M/748M [00:43<00:16, 14.1MB/s]
70%|███████████████████████████▏ | 523M/748M [00:43<00:15, 14.2MB/s]
70%|███████████████████████████▎ | 524M/748M [00:43<00:15, 14.2MB/s]
70%|███████████████████████████▍ | 525M/748M [00:43<00:15, 14.2MB/s]
70%|███████████████████████████▍ | 527M/748M [00:43<00:15, 14.2MB/s]
71%|███████████████████████████▌ | 528M/748M [00:43<00:15, 14.1MB/s]
71%|███████████████████████████▌ | 530M/748M [00:43<00:15, 14.1MB/s]
71%|███████████████████████████▋ | 531M/748M [00:43<00:15, 14.1MB/s]
71%|███████████████████████████▊ | 532M/748M [00:44<00:15, 14.1MB/s]
71%|███████████████████████████▊ | 534M/748M [00:44<00:15, 14.1MB/s]
72%|███████████████████████████▉ | 535M/748M [00:44<00:14, 14.2MB/s]
72%|███████████████████████████▉ | 537M/748M [00:44<00:14, 14.3MB/s]
72%|████████████████████████████ | 538M/748M [00:44<00:14, 14.2MB/s]
72%|████████████████████████████▏ | 540M/748M [00:44<00:14, 14.2MB/s]
72%|████████████████████████████▏ | 541M/748M [00:44<00:14, 14.4MB/s]
73%|████████████████████████████▎ | 543M/748M [00:44<00:14, 14.2MB/s]
73%|████████████████████████████▎ | 544M/748M [00:44<00:14, 14.2MB/s]
73%|████████████████████████████▍ | 545M/748M [00:44<00:14, 14.2MB/s]
73%|████████████████████████████▌ | 547M/748M [00:45<00:14, 14.3MB/s]
73%|████████████████████████████▌ | 548M/748M [00:45<00:14, 14.1MB/s]
73%|████████████████████████████▋ | 550M/748M [00:45<00:13, 14.2MB/s]
74%|████████████████████████████▋ | 551M/748M [00:45<00:13, 14.2MB/s]
74%|████████████████████████████▊ | 553M/748M [00:45<00:13, 14.2MB/s]
74%|████████████████████████████▉ | 554M/748M [00:45<00:13, 14.2MB/s]
74%|████████████████████████████▉ | 555M/748M [00:45<00:13, 14.2MB/s]
74%|█████████████████████████████ | 557M/748M [00:45<00:13, 14.2MB/s]
75%|█████████████████████████████ | 558M/748M [00:45<00:13, 14.2MB/s]
75%|█████████████████████████████▏ | 560M/748M [00:45<00:13, 14.2MB/s]
75%|█████████████████████████████▎ | 561M/748M [00:46<00:13, 14.3MB/s]
75%|█████████████████████████████▎ | 563M/748M [00:46<00:13, 14.2MB/s]
75%|█████████████████████████████▍ | 564M/748M [00:46<00:12, 14.3MB/s]
76%|█████████████████████████████▍ | 566M/748M [00:46<00:12, 14.2MB/s]
76%|█████████████████████████████▌ | 567M/748M [00:46<00:12, 14.3MB/s]
76%|█████████████████████████████▋ | 568M/748M [00:46<00:12, 14.3MB/s]
76%|█████████████████████████████▋ | 570M/748M [00:46<00:12, 14.2MB/s]
76%|█████████████████████████████▊ | 571M/748M [00:46<00:12, 14.1MB/s]
77%|█████████████████████████████▊ | 573M/748M [00:46<00:12, 14.1MB/s]
77%|█████████████████████████████▉ | 574M/748M [00:46<00:12, 14.2MB/s]
77%|██████████████████████████████ | 576M/748M [00:47<00:12, 14.2MB/s]
77%|██████████████████████████████ | 577M/748M [00:47<00:12, 14.2MB/s]
77%|██████████████████████████████▏ | 578M/748M [00:47<00:11, 14.3MB/s]
78%|██████████████████████████████▏ | 580M/748M [00:47<00:11, 14.2MB/s]
78%|██████████████████████████████▎ | 581M/748M [00:47<00:11, 14.3MB/s]
78%|██████████████████████████████▍ | 583M/748M [00:47<00:11, 14.3MB/s]
78%|██████████████████████████████▍ | 584M/748M [00:47<00:11, 14.2MB/s]
78%|██████████████████████████████▌ | 586M/748M [00:47<00:11, 14.2MB/s]
78%|██████████████████████████████▌ | 587M/748M [00:47<00:11, 14.2MB/s]
79%|██████████████████████████████▋ | 588M/748M [00:47<00:11, 14.1MB/s]
79%|██████████████████████████████▋ | 590M/748M [00:48<00:11, 14.2MB/s]
79%|██████████████████████████████▊ | 591M/748M [00:48<00:10, 14.3MB/s]
79%|██████████████████████████████▉ | 593M/748M [00:48<00:10, 14.2MB/s]
79%|██████████████████████████████▉ | 594M/748M [00:48<00:10, 14.3MB/s]
80%|███████████████████████████████ | 596M/748M [00:48<00:10, 14.2MB/s]
80%|███████████████████████████████▏ | 597M/748M [00:48<00:10, 14.3MB/s]
80%|███████████████████████████████▏ | 598M/748M [00:48<00:10, 14.2MB/s]
80%|███████████████████████████████▎ | 600M/748M [00:48<00:10, 14.3MB/s]
80%|███████████████████████████████▎ | 601M/748M [00:48<00:10, 14.0MB/s]
81%|███████████████████████████████▍ | 603M/748M [00:48<00:10, 13.5MB/s]
81%|███████████████████████████████▍ | 604M/748M [00:49<00:10, 13.1MB/s]
81%|███████████████████████████████▌ | 605M/748M [00:49<00:11, 12.8MB/s]
81%|███████████████████████████████▋ | 607M/748M [00:49<00:10, 13.2MB/s]
81%|███████████████████████████████▋ | 608M/748M [00:49<00:10, 13.5MB/s]
82%|███████████████████████████████▊ | 610M/748M [00:49<00:10, 13.6MB/s]
82%|███████████████████████████████▊ | 611M/748M [00:49<00:09, 13.8MB/s]
82%|███████████████████████████████▉ | 613M/748M [00:49<00:09, 14.1MB/s]
82%|████████████████████████████████ | 614M/748M [00:49<00:09, 14.0MB/s]
82%|████████████████████████████████ | 615M/748M [00:49<00:09, 14.2MB/s]
82%|████████████████████████████████▏ | 617M/748M [00:50<00:09, 14.1MB/s]
83%|████████████████████████████████▏ | 618M/748M [00:50<00:09, 14.2MB/s]
83%|████████████████████████████████▎ | 620M/748M [00:50<00:09, 14.2MB/s]
83%|████████████████████████████████▍ | 621M/748M [00:50<00:08, 14.3MB/s]
83%|████████████████████████████████▍ | 623M/748M [00:50<00:08, 14.2MB/s]
83%|████████████████████████████████▌ | 624M/748M [00:50<00:08, 14.3MB/s]
84%|████████████████████████████████▌ | 626M/748M [00:50<00:08, 14.3MB/s]
84%|████████████████████████████████▋ | 627M/748M [00:50<00:08, 14.2MB/s]
84%|████████████████████████████████▊ | 628M/748M [00:50<00:08, 14.3MB/s]
84%|████████████████████████████████▊ | 630M/748M [00:50<00:08, 14.3MB/s]
84%|████████████████████████████████▉ | 631M/748M [00:51<00:08, 14.2MB/s]
85%|████████████████████████████████▉ | 633M/748M [00:51<00:08, 14.2MB/s]
85%|█████████████████████████████████ | 634M/748M [00:51<00:07, 14.3MB/s]
85%|█████████████████████████████████▏ | 636M/748M [00:51<00:07, 14.3MB/s]
85%|█████████████████████████████████▏ | 637M/748M [00:51<00:07, 14.3MB/s]
85%|█████████████████████████████████▎ | 639M/748M [00:51<00:07, 14.4MB/s]
86%|█████████████████████████████████▎ | 640M/748M [00:51<00:07, 14.1MB/s]
86%|█████████████████████████████████▍ | 641M/748M [00:51<00:07, 14.4MB/s]
86%|█████████████████████████████████▌ | 643M/748M [00:51<00:07, 14.3MB/s]
86%|█████████████████████████████████▌ | 644M/748M [00:51<00:07, 14.1MB/s]
86%|█████████████████████████████████▋ | 646M/748M [00:52<00:07, 14.1MB/s]
87%|█████████████████████████████████▋ | 647M/748M [00:52<00:07, 14.2MB/s]
87%|█████████████████████████████████▊ | 649M/748M [00:52<00:07, 14.2MB/s]
87%|█████████████████████████████████▉ | 650M/748M [00:52<00:06, 14.3MB/s]
87%|█████████████████████████████████▉ | 652M/748M [00:52<00:06, 14.3MB/s]
87%|██████████████████████████████████ | 653M/748M [00:52<00:06, 14.3MB/s]
87%|██████████████████████████████████ | 654M/748M [00:52<00:06, 14.2MB/s]
88%|██████████████████████████████████▏ | 656M/748M [00:52<00:06, 14.3MB/s]
88%|██████████████████████████████████▎ | 657M/748M [00:52<00:06, 14.1MB/s]
88%|██████████████████████████████████▎ | 659M/748M [00:52<00:06, 14.3MB/s]
88%|██████████████████████████████████▍ | 660M/748M [00:53<00:06, 14.1MB/s]
88%|██████████████████████████████████▍ | 662M/748M [00:53<00:06, 14.4MB/s]
89%|██████████████████████████████████▌ | 663M/748M [00:53<00:06, 14.0MB/s]
89%|██████████████████████████████████▋ | 665M/748M [00:53<00:05, 14.4MB/s]
89%|██████████████████████████████████▋ | 666M/748M [00:53<00:05, 14.0MB/s]
89%|██████████████████████████████████▊ | 668M/748M [00:53<00:05, 14.3MB/s]
89%|██████████████████████████████████▉ | 669M/748M [00:53<00:05, 14.2MB/s]
90%|██████████████████████████████████▉ | 670M/748M [00:53<00:05, 14.3MB/s]
90%|███████████████████████████████████ | 672M/748M [00:53<00:05, 14.2MB/s]
90%|███████████████████████████████████ | 673M/748M [00:53<00:05, 14.4MB/s]
90%|███████████████████████████████████▏ | 675M/748M [00:54<00:05, 14.3MB/s]
90%|███████████████████████████████████▎ | 676M/748M [00:54<00:05, 14.0MB/s]
91%|███████████████████████████████████▎ | 678M/748M [00:54<00:04, 14.3MB/s]
91%|███████████████████████████████████▍ | 679M/748M [00:54<00:04, 14.1MB/s]
91%|███████████████████████████████████▍ | 681M/748M [00:54<00:04, 14.4MB/s]
91%|███████████████████████████████████▌ | 682M/748M [00:54<00:04, 14.1MB/s]
91%|███████████████████████████████████▋ | 684M/748M [00:54<00:04, 14.4MB/s]
92%|███████████████████████████████████▋ | 685M/748M [00:54<00:04, 14.1MB/s]
92%|███████████████████████████████████▊ | 687M/748M [00:54<00:04, 14.4MB/s]
92%|███████████████████████████████████▊ | 688M/748M [00:55<00:04, 14.2MB/s]
92%|███████████████████████████████████▉ | 689M/748M [00:55<00:04, 14.1MB/s]
92%|████████████████████████████████████ | 691M/748M [00:55<00:04, 14.2MB/s]
93%|████████████████████████████████████ | 692M/748M [00:55<00:03, 14.2MB/s]
93%|████████████████████████████████████▏ | 694M/748M [00:55<00:03, 14.3MB/s]
93%|████████████████████████████████████▏ | 695M/748M [00:55<00:03, 14.2MB/s]
93%|████████████████████████████████████▎ | 697M/748M [00:55<00:03, 14.3MB/s]
93%|████████████████████████████████████▍ | 698M/748M [00:55<00:03, 14.1MB/s]
94%|████████████████████████████████████▍ | 700M/748M [00:55<00:03, 14.4MB/s]
94%|████████████████████████████████████▌ | 701M/748M [00:55<00:03, 13.9MB/s]
94%|████████████████████████████████████▋ | 703M/748M [00:56<00:03, 14.3MB/s]
94%|████████████████████████████████████▋ | 704M/748M [00:56<00:03, 14.1MB/s]
94%|████████████████████████████████████▊ | 706M/748M [00:56<00:02, 14.4MB/s]
95%|████████████████████████████████████▊ | 707M/748M [00:56<00:02, 14.0MB/s]
95%|████████████████████████████████████▉ | 709M/748M [00:56<00:02, 14.3MB/s]
95%|█████████████████████████████████████ | 710M/748M [00:56<00:02, 14.2MB/s]
95%|█████████████████████████████████████ | 711M/748M [00:56<00:02, 14.0MB/s]
95%|█████████████████████████████████████▏ | 713M/748M [00:56<00:02, 14.3MB/s]
95%|█████████████████████████████████████▏ | 714M/748M [00:56<00:02, 14.1MB/s]
96%|█████████████████████████████████████▎ | 716M/748M [00:56<00:02, 14.2MB/s]
96%|█████████████████████████████████████▍ | 717M/748M [00:57<00:02, 14.0MB/s]
96%|█████████████████████████████████████▍ | 719M/748M [00:57<00:02, 14.2MB/s]
96%|█████████████████████████████████████▌ | 720M/748M [00:57<00:01, 14.2MB/s]
96%|█████████████████████████████████████▌ | 722M/748M [00:57<00:01, 14.3MB/s]
97%|█████████████████████████████████████▋ | 723M/748M [00:57<00:01, 14.2MB/s]
97%|█████████████████████████████████████▊ | 724M/748M [00:57<00:01, 14.2MB/s]
97%|█████████████████████████████████████▊ | 726M/748M [00:57<00:01, 14.2MB/s]
97%|█████████████████████████████████████▉ | 727M/748M [00:57<00:01, 14.0MB/s]
97%|█████████████████████████████████████▉ | 729M/748M [00:57<00:01, 14.4MB/s]
98%|██████████████████████████████████████ | 730M/748M [00:58<00:01, 14.0MB/s]
98%|██████████████████████████████████████▏| 732M/748M [00:58<00:01, 14.3MB/s]
98%|██████████████████████████████████████▏| 733M/748M [00:58<00:01, 14.1MB/s]
98%|██████████████████████████████████████▎| 735M/748M [00:58<00:00, 14.4MB/s]
98%|██████████████████████████████████████▍| 736M/748M [00:58<00:00, 14.0MB/s]
99%|██████████████████████████████████████▍| 738M/748M [00:58<00:00, 14.2MB/s]
99%|██████████████████████████████████████▌| 739M/748M [00:58<00:00, 14.1MB/s]
99%|██████████████████████████████████████▌| 741M/748M [00:58<00:00, 14.1MB/s]
99%|██████████████████████████████████████▋| 742M/748M [00:58<00:00, 14.1MB/s]
99%|██████████████████████████████████████▊| 743M/748M [00:58<00:00, 14.3MB/s]
100%|██████████████████████████████████████▊| 745M/748M [00:59<00:00, 14.2MB/s]
100%|██████████████████████████████████████▉| 746M/748M [00:59<00:00, 14.2MB/s]
100%|██████████████████████████████████████▉| 748M/748M [00:59<00:00, 14.2MB/s]
0%| | 0.00/748M [00:00<?, ?B/s]
100%|███████████████████████████████████████| 748M/748M [00:00<00:00, 1.17TB/s]
SHA256 hash of downloaded file: f444d0509a54af4d16184d251492780f1ffe2c444ded52e6b9c1b8b9e36503be Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future.
/opt/hostedtoolcache/Python/3.10.14/x64/lib/python3.10/site-packages/quackosm/pbf_file_reader.py:2393: UserWarning: Select clause contains more than 100 columns (found 332 columns). Query might fail with insufficient memory resources. Consider applying more restrictive OsmTagsFilter for parsing. warnings.warn(
Finished operation in 0:05:11
geometry | abandoned | access | admin_level | advertising | amenity | area:highway | artwork_type | atm | barrier | ... | tram | tunnel | type | vehicle | vending | waste | water | water_source | waterway | wheelchair | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
feature_id | |||||||||||||||||||||
node/1250635482 | POINT (16.37883 48.20857) | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
node/1350200407 | POINT (16.37488 48.21051) | None | None | None | None | ice_cream | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | no |
node/1360385587 | POINT (16.37741 48.20612) | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
node/1375294847 | POINT (16.35947 48.21124) | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
node/1375294851 | POINT (16.35848 48.21226) | None | None | None | None | restaurant | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | no |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
relation/12512007 | POLYGON ((16.36456 48.21109, 16.36455 48.21110... | None | None | None | None | None | None | None | None | None | ... | None | None | multipolygon | None | None | None | None | None | None | None |
relation/13052547 | POLYGON ((16.38105 48.20630, 16.38101 48.20628... | None | None | None | None | None | None | None | None | None | ... | None | None | multipolygon | None | None | None | None | None | None | None |
relation/13052548 | POLYGON ((16.38122 48.20624, 16.38121 48.20622... | None | None | None | None | None | None | None | None | None | ... | None | None | multipolygon | None | None | None | None | None | None | None |
relation/17553875 | POLYGON ((16.36461 48.20396, 16.36463 48.20397... | None | None | None | None | None | None | None | None | None | ... | None | None | multipolygon | None | None | None | None | None | None | None |
relation/17664508 | POLYGON ((16.36939 48.20957, 16.36942 48.20959... | None | None | None | None | None | None | None | None | None | ... | None | None | multipolygon | None | None | None | None | None | None | None |
21740 rows × 174 columns
Plot features¶
Uses default
preset colours from prettymaps
clipped_vienna_features_gdf = vienna_features_gdf.clip(vienna_center_circle)
ax = vienna_center_circle_gdf.plot(color="#F2F4CB", figsize=(16, 16))
# plot water
clipped_vienna_features_gdf.dropna(subset=["water", "waterway"], how="all").plot(
ax=ax, color="#a8e1e6"
)
# plot streets
clipped_vienna_features_gdf.dropna(subset=["highway"], how="all").plot(
ax=ax, color="#475657", markersize=0.1
)
# plot buildings
clipped_vienna_features_gdf.dropna(subset=["building"], how="all").plot(ax=ax, color="#FF5E5B")
# plot parkings
clipped_vienna_features_gdf[
(clipped_vienna_features_gdf["amenity"] == "parking")
| (clipped_vienna_features_gdf["highway"] == "pedestrian")
].plot(ax=ax, color="#2F3737", markersize=0.1)
# plot greenery
clipped_vienna_features_gdf[
clipped_vienna_features_gdf["landuse"].isin(
["grass", "orchard", "flowerbed", "forest", "greenfield", "meadow"]
)
].plot(ax=ax, color="#8BB174")
xmin, ymin, xmax, ymax = vienna_center_circle_gdf.total_bounds
ax.set_xlim(xmin, xmax)
ax.set_ylim(ymin, ymax)
ax.set_axis_off()
Download all grouped features based on Geofabrik layers in New York, USA¶
manhattan_bbox = box(-73.994551, 40.762396, -73.936872, 40.804239)
manhattan_bbox_gdf = gpd.GeoDataFrame(
geometry=[manhattan_bbox],
crs=WGS84_CRS,
index=gpd.pd.Index(data=["New York"], name=REGIONS_INDEX),
)
loader = OSMPbfLoader()
new_york_features_gdf = loader.load(manhattan_bbox_gdf, GEOFABRIK_LAYERS)
new_york_features_gdf
/opt/hostedtoolcache/Python/3.10.14/x64/lib/python3.10/site-packages/srai/loaders/osm_loaders/osm_pbf_loader.py:128: FutureWarning: Use `convert_geometry_to_geodataframe` instead. Deprecated since 0.8.1 version. features_gdf = pbf_reader.get_features_gdf_from_geometry( Downloading data from 'https://download.geofabrik.de/north-america/us/new-york-latest.osm.pbf' to file '/home/runner/work/srai/srai/examples/loaders/files/Geofabrik_us_new-york.osm.pbf'.
0%| | 0.00/446M [00:00<?, ?B/s]
0%| | 8.19k/446M [00:00<2:39:06, 46.7kB/s]
0%| | 36.9k/446M [00:00<1:05:07, 114kB/s]
0%| | 94.2k/446M [00:00<35:32, 209kB/s]
0%| | 209k/446M [00:00<19:31, 381kB/s]
0%| | 434k/446M [00:00<10:37, 700kB/s]
0%| | 889k/446M [00:01<05:35, 1.33MB/s]
0%|▏ | 1.80M/446M [00:01<02:53, 2.56MB/s]
1%|▎ | 3.62M/446M [00:01<01:28, 4.99MB/s]
1%|▌ | 6.26M/446M [00:01<00:54, 8.07MB/s]
2%|▊ | 8.95M/446M [00:01<00:42, 10.2MB/s]
3%|▉ | 11.3M/446M [00:01<00:39, 11.1MB/s]
3%|█▏ | 13.8M/446M [00:02<00:35, 12.1MB/s]
4%|█▍ | 16.2M/446M [00:02<00:34, 12.4MB/s]
4%|█▌ | 18.5M/446M [00:02<00:33, 12.6MB/s]
5%|█▊ | 20.9M/446M [00:02<00:32, 12.9MB/s]
5%|█▉ | 23.4M/446M [00:02<00:31, 13.2MB/s]
6%|██▏ | 25.7M/446M [00:03<00:32, 13.1MB/s]
6%|██▍ | 28.1M/446M [00:03<00:31, 13.2MB/s]
7%|██▌ | 30.5M/446M [00:03<00:31, 13.3MB/s]
7%|██▊ | 32.9M/446M [00:03<00:30, 13.3MB/s]
8%|███ | 35.3M/446M [00:03<00:30, 13.3MB/s]
8%|███▏ | 37.7M/446M [00:03<00:30, 13.4MB/s]
9%|███▍ | 40.0M/446M [00:04<00:30, 13.3MB/s]
10%|███▌ | 42.4M/446M [00:04<00:30, 13.4MB/s]
10%|███▊ | 44.8M/446M [00:04<00:30, 13.2MB/s]
11%|████ | 47.2M/446M [00:04<00:29, 13.3MB/s]
11%|████▏ | 49.5M/446M [00:04<00:30, 13.2MB/s]
12%|████▍ | 51.7M/446M [00:04<00:30, 13.1MB/s]
12%|████▌ | 54.1M/446M [00:05<00:30, 13.0MB/s]
13%|████▊ | 56.3M/446M [00:05<00:30, 12.9MB/s]
13%|████▉ | 58.6M/446M [00:05<00:30, 12.9MB/s]
14%|█████▏ | 61.0M/446M [00:05<00:29, 13.1MB/s]
14%|█████▍ | 63.3M/446M [00:05<00:29, 13.0MB/s]
15%|█████▌ | 65.6M/446M [00:06<00:29, 13.0MB/s]
15%|█████▊ | 67.9M/446M [00:06<00:29, 12.9MB/s]
16%|█████▉ | 70.2M/446M [00:06<00:29, 12.9MB/s]
16%|██████▏ | 72.5M/446M [00:06<00:29, 12.9MB/s]
17%|██████▎ | 74.7M/446M [00:06<00:28, 12.8MB/s]
17%|██████▌ | 77.1M/446M [00:06<00:28, 12.9MB/s]
18%|██████▊ | 79.4M/446M [00:07<00:28, 12.9MB/s]
18%|██████▉ | 81.6M/446M [00:07<00:28, 12.8MB/s]
19%|███████▏ | 83.9M/446M [00:07<00:28, 12.8MB/s]
19%|███████▎ | 86.2M/446M [00:07<00:28, 12.8MB/s]
20%|███████▌ | 88.5M/446M [00:07<00:27, 12.8MB/s]
20%|███████▋ | 90.7M/446M [00:08<00:27, 12.8MB/s]
21%|███████▉ | 93.0M/446M [00:08<00:27, 12.8MB/s]
21%|████████ | 95.3M/446M [00:08<00:27, 12.9MB/s]
22%|████████▎ | 97.6M/446M [00:08<00:27, 12.8MB/s]
22%|████████▌ | 99.9M/446M [00:08<00:27, 12.8MB/s]
23%|████████▉ | 102M/446M [00:08<00:26, 12.8MB/s]
23%|█████████ | 104M/446M [00:09<00:26, 12.7MB/s]
24%|█████████▎ | 107M/446M [00:09<00:26, 12.7MB/s]
24%|█████████▌ | 109M/446M [00:09<00:26, 12.7MB/s]
25%|█████████▋ | 111M/446M [00:09<00:26, 12.8MB/s]
25%|█████████▉ | 114M/446M [00:09<00:26, 12.8MB/s]
26%|██████████ | 116M/446M [00:09<00:25, 12.8MB/s]
26%|██████████▎ | 118M/446M [00:10<00:25, 12.8MB/s]
27%|██████████▌ | 120M/446M [00:10<00:25, 12.8MB/s]
27%|██████████▋ | 123M/446M [00:10<00:25, 12.8MB/s]
28%|██████████▉ | 125M/446M [00:10<00:25, 12.8MB/s]
29%|███████████ | 127M/446M [00:10<00:24, 12.8MB/s]
29%|███████████▎ | 130M/446M [00:11<00:24, 13.1MB/s]
30%|███████████▌ | 132M/446M [00:11<00:23, 13.2MB/s]
30%|███████████▊ | 135M/446M [00:11<00:23, 13.4MB/s]
31%|███████████▉ | 137M/446M [00:11<00:22, 13.6MB/s]
31%|████████████▏ | 140M/446M [00:11<00:22, 13.7MB/s]
32%|████████████▍ | 142M/446M [00:11<00:22, 13.7MB/s]
32%|████████████▌ | 144M/446M [00:12<00:19, 15.3MB/s]
33%|████████████▋ | 146M/446M [00:12<00:21, 13.9MB/s]
33%|████████████▉ | 147M/446M [00:12<00:22, 13.5MB/s]
33%|█████████████ | 149M/446M [00:12<00:19, 15.1MB/s]
34%|█████████████▏ | 151M/446M [00:12<00:21, 13.5MB/s]
34%|█████████████▎ | 152M/446M [00:12<00:23, 12.7MB/s]
35%|█████████████▍ | 154M/446M [00:12<00:22, 12.9MB/s]
35%|█████████████▋ | 156M/446M [00:12<00:20, 14.2MB/s]
35%|█████████████▊ | 158M/446M [00:13<00:22, 12.9MB/s]
36%|█████████████▉ | 159M/446M [00:13<00:23, 12.5MB/s]
36%|██████████████ | 161M/446M [00:13<00:20, 14.1MB/s]
36%|██████████████▏ | 162M/446M [00:13<00:22, 12.6MB/s]
37%|██████████████▎ | 164M/446M [00:13<00:22, 12.5MB/s]
37%|██████████████▍ | 165M/446M [00:13<00:19, 14.1MB/s]
37%|██████████████▌ | 167M/446M [00:13<00:21, 12.8MB/s]
38%|██████████████▋ | 168M/446M [00:13<00:22, 12.6MB/s]
38%|██████████████▊ | 170M/446M [00:14<00:19, 13.9MB/s]
38%|██████████████▉ | 171M/446M [00:14<00:21, 12.9MB/s]
39%|███████████████ | 173M/446M [00:14<00:21, 12.7MB/s]
39%|███████████████▎ | 175M/446M [00:14<00:19, 14.0MB/s]
39%|███████████████▍ | 176M/446M [00:14<00:20, 13.0MB/s]
40%|███████████████▌ | 178M/446M [00:14<00:21, 12.7MB/s]
40%|███████████████▋ | 179M/446M [00:14<00:19, 13.8MB/s]
41%|███████████████▊ | 181M/446M [00:14<00:20, 12.8MB/s]
41%|███████████████▉ | 182M/446M [00:14<00:20, 12.7MB/s]
41%|████████████████ | 184M/446M [00:15<00:19, 13.7MB/s]
42%|████████████████▏ | 185M/446M [00:15<00:20, 12.7MB/s]
42%|████████████████▎ | 187M/446M [00:15<00:21, 12.3MB/s]
42%|████████████████▍ | 189M/446M [00:15<00:18, 13.6MB/s]
43%|████████████████▌ | 190M/446M [00:15<00:20, 12.6MB/s]
43%|████████████████▋ | 191M/446M [00:15<00:20, 12.4MB/s]
43%|████████████████▉ | 193M/446M [00:15<00:18, 13.7MB/s]
44%|█████████████████ | 195M/446M [00:15<00:19, 12.6MB/s]
44%|█████████████████▏ | 196M/446M [00:16<00:20, 12.4MB/s]
44%|█████████████████▎ | 198M/446M [00:16<00:18, 13.7MB/s]
45%|█████████████████▍ | 199M/446M [00:16<00:19, 12.6MB/s]
45%|█████████████████▌ | 201M/446M [00:16<00:19, 12.4MB/s]
45%|█████████████████▋ | 202M/446M [00:16<00:17, 13.7MB/s]
46%|█████████████████▊ | 204M/446M [00:16<00:19, 12.6MB/s]
46%|█████████████████▉ | 205M/446M [00:16<00:19, 12.3MB/s]
46%|██████████████████ | 207M/446M [00:16<00:18, 13.3MB/s]
47%|██████████████████▏ | 208M/446M [00:17<00:18, 12.6MB/s]
47%|██████████████████▎ | 210M/446M [00:17<00:19, 12.4MB/s]
47%|██████████████████▍ | 212M/446M [00:17<00:17, 13.5MB/s]
48%|██████████████████▌ | 213M/446M [00:17<00:18, 12.7MB/s]
48%|██████████████████▋ | 215M/446M [00:17<00:18, 12.6MB/s]
48%|██████████████████▉ | 216M/446M [00:17<00:16, 13.6MB/s]
49%|███████████████████ | 218M/446M [00:17<00:17, 12.8MB/s]
49%|███████████████████▏ | 219M/446M [00:17<00:17, 12.6MB/s]
49%|███████████████████▎ | 221M/446M [00:17<00:16, 13.6MB/s]
50%|███████████████████▍ | 222M/446M [00:18<00:17, 12.7MB/s]
50%|███████████████████▌ | 224M/446M [00:18<00:17, 12.8MB/s]
51%|███████████████████▋ | 225M/446M [00:18<00:16, 13.6MB/s]
51%|███████████████████▊ | 227M/446M [00:18<00:17, 12.6MB/s]
51%|███████████████████▉ | 229M/446M [00:18<00:16, 13.2MB/s]
52%|████████████████████ | 230M/446M [00:18<00:15, 13.6MB/s]
52%|████████████████████▏ | 232M/446M [00:18<00:16, 12.7MB/s]
52%|████████████████████▍ | 233M/446M [00:18<00:16, 13.1MB/s]
53%|████████████████████▌ | 235M/446M [00:19<00:15, 13.7MB/s]
53%|████████████████████▋ | 236M/446M [00:19<00:16, 12.4MB/s]
53%|████████████████████▊ | 238M/446M [00:19<00:16, 13.0MB/s]
54%|████████████████████▉ | 239M/446M [00:19<00:15, 13.5MB/s]
54%|█████████████████████ | 241M/446M [00:19<00:16, 12.3MB/s]
54%|█████████████████████▏ | 242M/446M [00:19<00:15, 12.8MB/s]
55%|█████████████████████▎ | 244M/446M [00:19<00:15, 13.3MB/s]
55%|█████████████████████▍ | 245M/446M [00:19<00:16, 12.4MB/s]
55%|█████████████████████▌ | 247M/446M [00:19<00:15, 12.7MB/s]
56%|█████████████████████▋ | 248M/446M [00:20<00:15, 13.0MB/s]
56%|█████████████████████▊ | 250M/446M [00:20<00:16, 12.1MB/s]
56%|█████████████████████▉ | 251M/446M [00:20<00:15, 12.5MB/s]
57%|██████████████████████ | 253M/446M [00:20<00:14, 12.9MB/s]
57%|██████████████████████▏ | 254M/446M [00:20<00:15, 12.0MB/s]
57%|██████████████████████▎ | 256M/446M [00:20<00:15, 12.6MB/s]
58%|██████████████████████▍ | 257M/446M [00:20<00:14, 12.9MB/s]
58%|██████████████████████▌ | 259M/446M [00:20<00:15, 12.0MB/s]
58%|██████████████████████▊ | 260M/446M [00:21<00:14, 12.7MB/s]
59%|██████████████████████▉ | 262M/446M [00:21<00:14, 13.2MB/s]
59%|██████████████████████▉ | 263M/446M [00:21<00:15, 12.1MB/s]
59%|███████████████████████▏ | 265M/446M [00:21<00:14, 12.7MB/s]
60%|███████████████████████▎ | 266M/446M [00:21<00:13, 13.0MB/s]
60%|███████████████████████▍ | 268M/446M [00:21<00:14, 12.0MB/s]
60%|███████████████████████▌ | 269M/446M [00:21<00:13, 12.7MB/s]
61%|███████████████████████▋ | 271M/446M [00:21<00:13, 13.1MB/s]
61%|███████████████████████▊ | 272M/446M [00:22<00:14, 11.9MB/s]
61%|███████████████████████▉ | 274M/446M [00:22<00:13, 12.6MB/s]
62%|████████████████████████ | 275M/446M [00:22<00:13, 12.6MB/s]
62%|████████████████████████▏ | 276M/446M [00:22<00:13, 12.5MB/s]
62%|████████████████████████▎ | 278M/446M [00:22<00:12, 13.4MB/s]
63%|████████████████████████▍ | 279M/446M [00:22<00:13, 12.6MB/s]
63%|████████████████████████▌ | 281M/446M [00:22<00:12, 12.8MB/s]
63%|████████████████████████▋ | 282M/446M [00:22<00:12, 12.7MB/s]
63%|████████████████████████▊ | 283M/446M [00:22<00:12, 12.6MB/s]
64%|████████████████████████▉ | 285M/446M [00:22<00:11, 13.5MB/s]
64%|█████████████████████████ | 286M/446M [00:23<00:12, 12.5MB/s]
64%|█████████████████████████▏ | 288M/446M [00:23<00:12, 12.8MB/s]
65%|█████████████████████████▏ | 289M/446M [00:23<00:12, 12.8MB/s]
65%|█████████████████████████▎ | 290M/446M [00:23<00:12, 12.7MB/s]
65%|█████████████████████████▍ | 292M/446M [00:23<00:11, 13.6MB/s]
66%|█████████████████████████▌ | 293M/446M [00:23<00:12, 12.5MB/s]
66%|█████████████████████████▋ | 294M/446M [00:23<00:11, 12.7MB/s]
66%|█████████████████████████▊ | 296M/446M [00:23<00:11, 12.6MB/s]
67%|█████████████████████████▉ | 297M/446M [00:23<00:11, 12.6MB/s]
67%|██████████████████████████ | 298M/446M [00:24<00:11, 13.1MB/s]
67%|██████████████████████████▏ | 300M/446M [00:24<00:12, 12.2MB/s]
68%|██████████████████████████▎ | 301M/446M [00:24<00:11, 12.8MB/s]
68%|██████████████████████████▍ | 303M/446M [00:24<00:11, 13.0MB/s]
68%|██████████████████████████▌ | 304M/446M [00:24<00:10, 13.0MB/s]
68%|██████████████████████████▋ | 305M/446M [00:24<00:10, 13.3MB/s]
69%|██████████████████████████▊ | 307M/446M [00:24<00:11, 12.2MB/s]
69%|██████████████████████████▉ | 308M/446M [00:24<00:10, 13.1MB/s]
69%|███████████████████████████ | 310M/446M [00:24<00:10, 13.0MB/s]
70%|███████████████████████████▏ | 311M/446M [00:25<00:10, 12.9MB/s]
70%|███████████████████████████▎ | 312M/446M [00:25<00:10, 13.1MB/s]
70%|███████████████████████████▍ | 314M/446M [00:25<00:10, 12.2MB/s]
71%|███████████████████████████▌ | 315M/446M [00:25<00:10, 12.9MB/s]
71%|███████████████████████████▋ | 316M/446M [00:25<00:10, 12.8MB/s]
71%|███████████████████████████▊ | 318M/446M [00:25<00:10, 12.3MB/s]
72%|███████████████████████████▉ | 319M/446M [00:25<00:09, 13.6MB/s]
72%|████████████████████████████ | 321M/446M [00:25<00:09, 12.7MB/s]
72%|████████████████████████████▏ | 322M/446M [00:25<00:09, 12.6MB/s]
72%|████████████████████████████▎ | 323M/446M [00:26<00:09, 12.6MB/s]
73%|████████████████████████████▎ | 325M/446M [00:26<00:10, 11.8MB/s]
73%|████████████████████████████▌ | 326M/446M [00:26<00:09, 12.8MB/s]
73%|████████████████████████████▋ | 328M/446M [00:26<00:09, 12.7MB/s]
74%|████████████████████████████▋ | 329M/446M [00:26<00:09, 12.7MB/s]
74%|████████████████████████████▊ | 330M/446M [00:26<00:09, 12.8MB/s]
74%|████████████████████████████▉ | 332M/446M [00:26<00:09, 11.8MB/s]
75%|█████████████████████████████ | 333M/446M [00:26<00:08, 12.8MB/s]
75%|█████████████████████████████▏ | 334M/446M [00:26<00:08, 12.8MB/s]
75%|█████████████████████████████▎ | 336M/446M [00:26<00:08, 12.7MB/s]
76%|█████████████████████████████▍ | 337M/446M [00:27<00:08, 13.1MB/s]
76%|█████████████████████████████▌ | 338M/446M [00:27<00:09, 11.9MB/s]
76%|█████████████████████████████▋ | 340M/446M [00:27<00:08, 12.8MB/s]
76%|█████████████████████████████▊ | 341M/446M [00:27<00:08, 13.1MB/s]
77%|█████████████████████████████▉ | 343M/446M [00:27<00:08, 12.6MB/s]
77%|██████████████████████████████ | 344M/446M [00:27<00:07, 13.4MB/s]
77%|██████████████████████████████▏ | 346M/446M [00:27<00:08, 12.2MB/s]
78%|██████████████████████████████▎ | 347M/446M [00:27<00:07, 13.0MB/s]
78%|██████████████████████████████▍ | 348M/446M [00:27<00:07, 13.3MB/s]
78%|██████████████████████████████▌ | 350M/446M [00:28<00:08, 12.0MB/s]
79%|██████████████████████████████▋ | 351M/446M [00:28<00:07, 12.9MB/s]
79%|██████████████████████████████▊ | 353M/446M [00:28<00:07, 12.8MB/s]
79%|██████████████████████████████▉ | 354M/446M [00:28<00:07, 12.3MB/s]
80%|███████████████████████████████ | 356M/446M [00:28<00:06, 13.5MB/s]
80%|███████████████████████████████▏ | 357M/446M [00:28<00:07, 12.2MB/s]
80%|███████████████████████████████▎ | 359M/446M [00:28<00:06, 12.6MB/s]
81%|███████████████████████████████▍ | 360M/446M [00:28<00:06, 13.5MB/s]
81%|███████████████████████████████▌ | 361M/446M [00:29<00:06, 12.2MB/s]
81%|███████████████████████████████▋ | 363M/446M [00:29<00:06, 12.7MB/s]
82%|███████████████████████████████▊ | 364M/446M [00:29<00:06, 12.8MB/s]
82%|███████████████████████████████▉ | 366M/446M [00:29<00:06, 12.1MB/s]
82%|████████████████████████████████ | 367M/446M [00:29<00:06, 12.7MB/s]
83%|████████████████████████████████▏ | 368M/446M [00:29<00:06, 12.3MB/s]
83%|████████████████████████████████▎ | 370M/446M [00:29<00:06, 12.4MB/s]
83%|████████████████████████████████▍ | 371M/446M [00:29<00:05, 13.3MB/s]
83%|████████████████████████████████▌ | 373M/446M [00:29<00:06, 11.9MB/s]
84%|████████████████████████████████▋ | 374M/446M [00:30<00:05, 12.6MB/s]
84%|████████████████████████████████▊ | 375M/446M [00:30<00:05, 12.7MB/s]
84%|████████████████████████████████▉ | 377M/446M [00:30<00:05, 12.0MB/s]
85%|█████████████████████████████████ | 378M/446M [00:30<00:05, 13.1MB/s]
85%|█████████████████████████████████▏ | 380M/446M [00:30<00:05, 12.6MB/s]
85%|█████████████████████████████████▎ | 381M/446M [00:30<00:05, 12.7MB/s]
86%|█████████████████████████████████▍ | 383M/446M [00:30<00:04, 13.6MB/s]
86%|█████████████████████████████████▌ | 384M/446M [00:30<00:05, 12.2MB/s]
86%|█████████████████████████████████▋ | 385M/446M [00:30<00:04, 12.8MB/s]
87%|█████████████████████████████████▊ | 387M/446M [00:31<00:04, 12.9MB/s]
87%|█████████████████████████████████▉ | 388M/446M [00:31<00:04, 12.2MB/s]
87%|██████████████████████████████████ | 390M/446M [00:31<00:04, 13.0MB/s]
88%|██████████████████████████████████▏ | 391M/446M [00:31<00:04, 12.5MB/s]
88%|██████████████████████████████████▎ | 392M/446M [00:31<00:04, 12.7MB/s]
88%|██████████████████████████████████▍ | 394M/446M [00:31<00:03, 13.6MB/s]
89%|██████████████████████████████████▌ | 395M/446M [00:31<00:04, 12.1MB/s]
89%|██████████████████████████████████▋ | 397M/446M [00:31<00:03, 12.9MB/s]
89%|██████████████████████████████████▊ | 398M/446M [00:31<00:03, 12.9MB/s]
90%|██████████████████████████████████▉ | 400M/446M [00:32<00:03, 12.3MB/s]
90%|███████████████████████████████████ | 401M/446M [00:32<00:03, 13.2MB/s]
90%|███████████████████████████████████▏ | 402M/446M [00:32<00:03, 12.3MB/s]
90%|███████████████████████████████████▎ | 404M/446M [00:32<00:03, 12.6MB/s]
91%|███████████████████████████████████▍ | 406M/446M [00:32<00:02, 13.8MB/s]
91%|███████████████████████████████████▌ | 407M/446M [00:32<00:03, 12.4MB/s]
91%|███████████████████████████████████▋ | 408M/446M [00:32<00:02, 12.7MB/s]
92%|███████████████████████████████████▊ | 410M/446M [00:32<00:02, 13.4MB/s]
92%|███████████████████████████████████▉ | 411M/446M [00:32<00:02, 11.9MB/s]
93%|████████████████████████████████████ | 413M/446M [00:33<00:02, 13.0MB/s]
93%|████████████████████████████████████▏ | 414M/446M [00:33<00:02, 13.0MB/s]
93%|████████████████████████████████████▎ | 416M/446M [00:33<00:02, 12.0MB/s]
93%|████████████████████████████████████▍ | 417M/446M [00:33<00:02, 13.1MB/s]
94%|████████████████████████████████████▌ | 419M/446M [00:33<00:02, 12.6MB/s]
94%|████████████████████████████████████▋ | 420M/446M [00:33<00:02, 12.4MB/s]
94%|████████████████████████████████████▊ | 422M/446M [00:33<00:01, 13.6MB/s]
95%|████████████████████████████████████▉ | 423M/446M [00:33<00:01, 12.1MB/s]
95%|█████████████████████████████████████ | 424M/446M [00:33<00:01, 12.3MB/s]
95%|█████████████████████████████████████▏ | 426M/446M [00:34<00:01, 13.0MB/s]
96%|█████████████████████████████████████▎ | 427M/446M [00:34<00:01, 11.9MB/s]
96%|█████████████████████████████████████▍ | 429M/446M [00:34<00:01, 13.1MB/s]
96%|█████████████████████████████████████▌ | 430M/446M [00:34<00:01, 12.9MB/s]
97%|█████████████████████████████████████▋ | 431M/446M [00:34<00:01, 12.4MB/s]
97%|█████████████████████████████████████▊ | 433M/446M [00:34<00:01, 13.1MB/s]
97%|█████████████████████████████████████▉ | 434M/446M [00:34<00:00, 12.4MB/s]
98%|██████████████████████████████████████ | 436M/446M [00:34<00:00, 12.8MB/s]
98%|██████████████████████████████████████▏| 437M/446M [00:34<00:00, 12.9MB/s]
98%|██████████████████████████████████████▎| 438M/446M [00:35<00:00, 12.7MB/s]
99%|██████████████████████████████████████▍| 440M/446M [00:35<00:00, 13.5MB/s]
99%|██████████████████████████████████████▌| 441M/446M [00:35<00:00, 12.6MB/s]
99%|██████████████████████████████████████▋| 443M/446M [00:35<00:00, 12.8MB/s]
99%|██████████████████████████████████████▊| 444M/446M [00:35<00:00, 13.0MB/s]
100%|██████████████████████████████████████▉| 445M/446M [00:35<00:00, 12.4MB/s]
0%| | 0.00/446M [00:00<?, ?B/s]
100%|████████████████████████████████████████| 446M/446M [00:00<00:00, 555GB/s]
SHA256 hash of downloaded file: aa3944e9f0eb52d4d30287d0e625b96026bd4d0c784faf81f744ac2998b15d1d Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future.
Downloading data from 'https://download.geofabrik.de/north-america/us/new-jersey-latest.osm.pbf' to file '/home/runner/work/srai/srai/examples/loaders/files/Geofabrik_us_new-jersey.osm.pbf'.
0%| | 0.00/145M [00:00<?, ?B/s]
0%| | 8.19k/145M [00:00<51:37, 46.8kB/s]
0%| | 36.9k/145M [00:00<21:14, 114kB/s]
0%| | 94.2k/145M [00:00<11:35, 208kB/s]
0%| | 209k/145M [00:00<06:21, 379kB/s]
0%| | 434k/145M [00:00<03:27, 697kB/s]
1%|▏ | 889k/145M [00:01<01:48, 1.32MB/s]
1%|▍ | 1.80M/145M [00:01<00:56, 2.55MB/s]
2%|▉ | 3.60M/145M [00:01<00:25, 5.51MB/s]
3%|█▏ | 4.71M/145M [00:01<00:20, 6.73MB/s]
4%|█▋ | 6.26M/145M [00:01<00:17, 8.14MB/s]
6%|██▏ | 8.40M/145M [00:01<00:12, 11.3MB/s]
7%|██▌ | 9.68M/145M [00:01<00:12, 10.6MB/s]
7%|██▊ | 10.8M/145M [00:01<00:13, 10.2MB/s]
9%|███▍ | 13.0M/145M [00:02<00:12, 10.9MB/s]
10%|███▉ | 15.1M/145M [00:02<00:09, 13.3MB/s]
11%|████▎ | 16.5M/145M [00:02<00:10, 12.2MB/s]
12%|████▋ | 17.8M/145M [00:02<00:11, 11.4MB/s]
14%|█████▏ | 19.8M/145M [00:02<00:10, 11.9MB/s]
15%|█████▋ | 21.8M/145M [00:02<00:08, 13.8MB/s]
16%|██████ | 23.3M/145M [00:02<00:09, 12.5MB/s]
17%|██████▍ | 24.6M/145M [00:03<00:10, 11.7MB/s]
18%|██████▉ | 26.3M/145M [00:03<00:10, 11.4MB/s]
20%|███████▍ | 28.3M/145M [00:03<00:08, 13.3MB/s]
20%|███████▊ | 29.7M/145M [00:03<00:09, 12.2MB/s]
21%|████████ | 30.9M/145M [00:03<00:09, 11.4MB/s]
23%|████████▋ | 32.9M/145M [00:03<00:09, 11.7MB/s]
24%|█████████▏ | 34.8M/145M [00:03<00:08, 13.4MB/s]
25%|█████████▌ | 36.2M/145M [00:03<00:08, 12.4MB/s]
26%|█████████▊ | 37.5M/145M [00:04<00:09, 11.7MB/s]
27%|██████████▎ | 39.5M/145M [00:04<00:07, 13.6MB/s]
28%|██████████▋ | 40.9M/145M [00:04<00:08, 12.5MB/s]
29%|███████████ | 42.2M/145M [00:04<00:08, 11.7MB/s]
30%|███████████▌ | 44.0M/145M [00:04<00:08, 11.7MB/s]
32%|████████████ | 45.8M/145M [00:04<00:07, 13.1MB/s]
33%|████████████▍ | 47.2M/145M [00:04<00:07, 12.2MB/s]
33%|████████████▋ | 48.4M/145M [00:05<00:08, 11.6MB/s]
35%|█████████████▏ | 50.2M/145M [00:05<00:07, 13.2MB/s]
36%|█████████████▌ | 51.6M/145M [00:05<00:07, 12.1MB/s]
36%|█████████████▊ | 52.8M/145M [00:05<00:07, 11.6MB/s]
38%|██████████████▎ | 54.6M/145M [00:05<00:06, 13.1MB/s]
39%|██████████████▋ | 55.9M/145M [00:05<00:07, 12.0MB/s]
39%|███████████████ | 57.2M/145M [00:05<00:07, 11.4MB/s]
41%|███████████████▍ | 59.0M/145M [00:05<00:06, 13.2MB/s]
42%|███████████████▊ | 60.4M/145M [00:05<00:06, 12.2MB/s]
43%|████████████████▏ | 61.7M/145M [00:06<00:07, 11.5MB/s]
44%|████████████████▋ | 63.4M/145M [00:06<00:06, 13.0MB/s]
45%|████████████████▉ | 64.7M/145M [00:06<00:06, 12.1MB/s]
46%|█████████████████▎ | 66.0M/145M [00:06<00:06, 11.5MB/s]
47%|█████████████████▊ | 67.8M/145M [00:06<00:05, 13.0MB/s]
48%|██████████████████▏ | 69.1M/145M [00:06<00:06, 12.0MB/s]
49%|██████████████████▍ | 70.3M/145M [00:06<00:06, 11.4MB/s]
50%|██████████████████▉ | 72.2M/145M [00:06<00:05, 13.4MB/s]
51%|███████████████████▎ | 73.6M/145M [00:07<00:05, 12.3MB/s]
52%|███████████████████▋ | 74.9M/145M [00:07<00:06, 11.6MB/s]
53%|████████████████████ | 76.6M/145M [00:07<00:05, 12.8MB/s]
54%|████████████████████▍ | 77.9M/145M [00:07<00:05, 12.1MB/s]
55%|████████████████████▊ | 79.2M/145M [00:07<00:05, 11.5MB/s]
56%|█████████████████████▏ | 80.9M/145M [00:07<00:04, 13.0MB/s]
57%|█████████████████████▌ | 82.2M/145M [00:07<00:05, 12.0MB/s]
58%|█████████████████████▉ | 83.5M/145M [00:07<00:05, 11.4MB/s]
59%|██████████████████████▎ | 85.2M/145M [00:07<00:04, 13.0MB/s]
60%|██████████████████████▋ | 86.5M/145M [00:08<00:04, 11.9MB/s]
61%|███████████████████████ | 87.8M/145M [00:08<00:05, 11.3MB/s]
62%|███████████████████████▍ | 89.5M/145M [00:08<00:04, 12.9MB/s]
63%|███████████████████████▊ | 90.9M/145M [00:08<00:04, 11.9MB/s]
64%|████████████████████████▏ | 92.1M/145M [00:08<00:04, 11.4MB/s]
65%|████████████████████████▌ | 93.8M/145M [00:08<00:03, 12.9MB/s]
66%|████████████████████████▉ | 95.2M/145M [00:08<00:04, 12.0MB/s]
67%|█████████████████████████▎ | 96.4M/145M [00:08<00:04, 11.3MB/s]
68%|█████████████████████████▊ | 98.2M/145M [00:09<00:03, 12.9MB/s]
69%|██████████████████████████▏ | 99.6M/145M [00:09<00:03, 12.1MB/s]
70%|███████████████████████████▏ | 101M/145M [00:09<00:03, 11.4MB/s]
71%|███████████████████████████▌ | 103M/145M [00:09<00:03, 12.9MB/s]
72%|███████████████████████████▉ | 104M/145M [00:09<00:03, 12.0MB/s]
73%|████████████████████████████▎ | 105M/145M [00:09<00:03, 11.3MB/s]
74%|████████████████████████████▊ | 107M/145M [00:09<00:02, 12.8MB/s]
75%|█████████████████████████████ | 108M/145M [00:09<00:03, 12.0MB/s]
76%|█████████████████████████████▍ | 109M/145M [00:10<00:03, 11.3MB/s]
77%|█████████████████████████████▉ | 111M/145M [00:10<00:02, 12.9MB/s]
78%|██████████████████████████████▎ | 112M/145M [00:10<00:02, 12.0MB/s]
79%|██████████████████████████████▌ | 114M/145M [00:10<00:02, 11.3MB/s]
80%|███████████████████████████████ | 115M/145M [00:10<00:02, 12.8MB/s]
81%|███████████████████████████████▍ | 117M/145M [00:10<00:02, 12.0MB/s]
81%|███████████████████████████████▊ | 118M/145M [00:10<00:02, 11.3MB/s]
83%|████████████████████████████████▏ | 120M/145M [00:10<00:01, 12.8MB/s]
84%|████████████████████████████████▌ | 121M/145M [00:10<00:01, 12.0MB/s]
84%|████████████████████████████████▉ | 122M/145M [00:11<00:01, 11.3MB/s]
86%|█████████████████████████████████▍ | 124M/145M [00:11<00:01, 12.8MB/s]
87%|█████████████████████████████████▊ | 125M/145M [00:11<00:01, 12.1MB/s]
87%|██████████████████████████████████ | 127M/145M [00:11<00:01, 11.3MB/s]
89%|██████████████████████████████████▌ | 128M/145M [00:11<00:01, 12.7MB/s]
89%|██████████████████████████████████▉ | 130M/145M [00:11<00:01, 12.1MB/s]
90%|███████████████████████████████████▏ | 131M/145M [00:11<00:01, 11.4MB/s]
92%|███████████████████████████████████▋ | 133M/145M [00:11<00:00, 12.9MB/s]
92%|████████████████████████████████████ | 134M/145M [00:12<00:00, 12.0MB/s]
93%|████████████████████████████████████▍ | 135M/145M [00:12<00:00, 11.6MB/s]
95%|████████████████████████████████████▊ | 137M/145M [00:12<00:00, 13.0MB/s]
95%|█████████████████████████████████████▏ | 138M/145M [00:12<00:00, 12.1MB/s]
96%|█████████████████████████████████████▌ | 140M/145M [00:12<00:00, 11.6MB/s]
98%|██████████████████████████████████████ | 141M/145M [00:12<00:00, 12.8MB/s]
98%|██████████████████████████████████████▍| 143M/145M [00:12<00:00, 12.1MB/s]
99%|██████████████████████████████████████▊| 144M/145M [00:12<00:00, 11.6MB/s]
0%| | 0.00/145M [00:00<?, ?B/s]
100%|████████████████████████████████████████| 145M/145M [00:00<00:00, 156GB/s]
SHA256 hash of downloaded file: 969823d398a5427811f33c237567ae1876d603259eb68dee530626455327d802 Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future.
Finished operation in 0:03:08
geometry | accommodation | buildings | catering | education | fuel_parking | health | highway_links | landuse | leisure | ... | public | railways | shopping | tourism | traffic | transport | very_small_roads | water | water_traffic | waterways | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
feature_id | |||||||||||||||||||||
way/266900662 | POLYGON ((-73.95228 40.77137, -73.95236 40.771... | None | building=yes | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
way/766496197 | LINESTRING (-73.95487 40.78345, -73.95493 40.7... | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
way/1098847602 | LINESTRING (-73.97340 40.79274, -73.97344 40.7... | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
node/2761520418 | POINT (-73.96855 40.79975) | None | None | amenity=restaurant | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
way/266904093 | POLYGON ((-73.94647 40.77372, -73.94648 40.773... | None | building=yes | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
way/426502694 | LINESTRING (-73.97161 40.77347, -73.97161 40.7... | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
way/266909596 | POLYGON ((-73.95309 40.77530, -73.95312 40.775... | None | building=yes | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
way/815947026 | LINESTRING (-73.94041 40.80206, -73.94020 40.8... | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | highway=service | None | None | None |
node/2477910751 | POINT (-73.94051 40.76549) | None | None | None | None | None | None | None | None | None | ... | None | None | None | None | None | None | None | None | None | None |
node/8333740822 | POINT (-73.98534 40.77069) | None | None | None | None | None | None | None | None | None | ... | None | None | shop=books | None | None | None | None | None | None | None |
47692 rows × 27 columns
Plot features¶
Inspired by https://snazzymaps.com/style/14889/flat-pale
ax = manhattan_bbox_gdf.plot(color="#e7e7df", figsize=(16, 16))
# plot greenery
new_york_features_gdf[new_york_features_gdf["leisure"] == "leisure=park"].plot(
ax=ax, color="#bae5ce"
)
# plot water
new_york_features_gdf.dropna(subset=["water", "waterways"], how="all").plot(ax=ax, color="#c7eced")
# plot streets
new_york_features_gdf.dropna(subset=["paths_unsuitable_for_cars"], how="all").plot(
ax=ax, color="#e7e7df", linewidth=1
)
new_york_features_gdf.dropna(
subset=["very_small_roads", "highway_links", "minor_roads"], how="all"
).plot(ax=ax, color="#fff", linewidth=2)
new_york_features_gdf.dropna(subset=["major_roads"], how="all").plot(
ax=ax, color="#fac9a9", linewidth=3
)
# plot buildings
new_york_features_gdf.dropna(subset=["buildings"], how="all").plot(ax=ax, color="#cecebd")
xmin, ymin, xmax, ymax = manhattan_bbox_gdf.total_bounds
ax.set_xlim(xmin, xmax)
ax.set_ylim(ymin, ymax)
ax.set_axis_off()
Using OSMPbfLoader to download data for a specific area and transforming it to GeoParquet file¶
Download all grouped features based on Geofabrik layers in Reykjavík, Iceland¶
loader = OSMPbfLoader()
reykjavik_gdf = geocode_to_region_gdf("Reykjavík, IS")
reykjavik_features_gpq = loader.load_to_geoparquet(reykjavik_gdf, GEOFABRIK_LAYERS)
reykjavik_features_gpq
/opt/hostedtoolcache/Python/3.10.14/x64/lib/python3.10/site-packages/srai/loaders/osm_loaders/osm_pbf_loader.py:191: FutureWarning: Use `convert_geometry_to_parquet` instead. Deprecated since 0.8.1 version. geoparquet_file_path = pbf_reader.convert_geometry_filter_to_gpq( Downloading data from 'https://download.geofabrik.de/europe/iceland-latest.osm.pbf' to file '/home/runner/work/srai/srai/examples/loaders/files/Geofabrik_iceland.osm.pbf'.
0%| | 0.00/60.1M [00:00<?, ?B/s]
0%| | 8.19k/60.1M [00:00<21:24, 46.8kB/s]
0%| | 36.9k/60.1M [00:00<08:46, 114kB/s]
0%| | 94.2k/60.1M [00:00<04:47, 209kB/s]
0%|▏ | 209k/60.1M [00:00<02:37, 379kB/s]
1%|▎ | 434k/60.1M [00:00<01:25, 696kB/s]
1%|▌ | 889k/60.1M [00:01<00:44, 1.32MB/s]
3%|█ | 1.80M/60.1M [00:01<00:22, 2.55MB/s]
6%|██▏ | 3.62M/60.1M [00:01<00:11, 4.97MB/s]
10%|███▊ | 6.28M/60.1M [00:01<00:06, 8.06MB/s]
14%|█████▎ | 8.59M/60.1M [00:01<00:05, 9.57MB/s]
18%|██████▊ | 11.1M/60.1M [00:01<00:04, 10.9MB/s]
22%|████████▎ | 13.4M/60.1M [00:02<00:04, 11.6MB/s]
27%|█████████▊ | 16.0M/60.1M [00:02<00:03, 12.4MB/s]
30%|███████████▎ | 18.3M/60.1M [00:02<00:03, 12.6MB/s]
34%|████████████▋ | 20.6M/60.1M [00:02<00:03, 12.7MB/s]
39%|██████████████▎ | 23.3M/60.1M [00:02<00:02, 13.3MB/s]
43%|███████████████▋ | 25.5M/60.1M [00:03<00:02, 13.1MB/s]
47%|█████████████████▏ | 27.9M/60.1M [00:03<00:02, 13.2MB/s]
50%|██████████████████▋ | 30.2M/60.1M [00:03<00:02, 13.1MB/s]
54%|████████████████████ | 32.6M/60.1M [00:03<00:02, 13.1MB/s]
58%|█████████████████████▍ | 34.9M/60.1M [00:03<00:01, 13.0MB/s]
62%|██████████████████████▉ | 37.2M/60.1M [00:03<00:01, 13.0MB/s]
66%|████████████████████████▎ | 39.5M/60.1M [00:04<00:01, 12.9MB/s]
70%|█████████████████████████▋ | 41.8M/60.1M [00:04<00:01, 12.9MB/s]
74%|███████████████████████████▏ | 44.2M/60.1M [00:04<00:01, 13.0MB/s]
77%|████████████████████████████▋ | 46.5M/60.1M [00:04<00:01, 13.0MB/s]
81%|██████████████████████████████ | 48.8M/60.1M [00:04<00:00, 13.0MB/s]
85%|███████████████████████████████▌ | 51.1M/60.1M [00:05<00:00, 13.0MB/s]
89%|█████████████████████████████████ | 53.7M/60.1M [00:05<00:00, 13.3MB/s]
93%|██████████████████████████████████▍ | 55.9M/60.1M [00:05<00:00, 13.1MB/s]
97%|███████████████████████████████████▊ | 58.2M/60.1M [00:05<00:00, 13.0MB/s]
0%| | 0.00/60.1M [00:00<?, ?B/s]
100%|█████████████████████████████████████| 60.1M/60.1M [00:00<00:00, 66.4GB/s]
SHA256 hash of downloaded file: 60ad7fa2bb26be88ab39dcf2a4915132e3fbcc9af63cdeb2e656c811f511f670 Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future.
Finished operation in 0:00:23
PosixPath('files/f2f6702ed375b9cc7c1af2b83286016228f49730ff409f3e255b136a0fcce996_098931824b94bfe02e01bc4987422a39ec47bd3f6924e5325ddae0846badafba_exploded.parquet')
Read those features using DuckDB¶
import duckdb
connection = duckdb.connect()
connection.load_extension("parquet")
connection.load_extension("spatial")
features_relation = connection.read_parquet(str(reykjavik_features_gpq)).project(
"* REPLACE (ST_GeomFromWKB(geometry) AS geometry)"
)
features_relation
┌─────────────────┬───────────────┬─────────────┬───┬─────────┬───────────────┬───────────┬──────────────────────┐ │ feature_id │ accommodation │ air_traffic │ … │ water │ water_traffic │ waterways │ geometry │ │ varchar │ varchar │ varchar │ │ varchar │ varchar │ varchar │ geometry │ ├─────────────────┼───────────────┼─────────────┼───┼─────────┼───────────────┼───────────┼──────────────────────┤ │ node/13472516 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.7847679… │ │ node/13489663 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.8324909… │ │ node/14586972 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.7644946… │ │ node/16570604 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.7909159… │ │ node/169087860 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9458058… │ │ node/181003495 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9519829… │ │ node/181003555 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9524324… │ │ node/181797458 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9525919… │ │ node/196382899 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9521497… │ │ node/196382907 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9496356… │ │ · │ · │ · │ · │ · │ · │ · │ · │ │ · │ · │ · │ · │ · │ · │ · │ · │ │ · │ · │ · │ · │ · │ · │ · │ · │ │ node/2004274549 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9006636… │ │ node/2004274553 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9074806… │ │ node/2004274554 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9069323… │ │ node/2004274557 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.8946369… │ │ node/2004274561 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.8954392… │ │ node/2004274564 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.8962997… │ │ node/2004274568 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.899306 … │ │ node/2004274575 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9093655… │ │ node/2004274576 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9047261… │ │ node/2004274578 │ NULL │ NULL │ … │ NULL │ NULL │ NULL │ POINT (-21.9033679… │ ├─────────────────┴───────────────┴─────────────┴───┴─────────┴───────────────┴───────────┴──────────────────────┤ │ ? rows (>9999 rows, 20 shown) 29 columns (7 shown) │ └────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
Count all buildings¶
features_relation.filter("buildings IS NOT NULL").count("feature_id")
┌───────────────────┐ │ count(feature_id) │ │ int64 │ ├───────────────────┤ │ 25305 │ └───────────────────┘
You can see more examples of how to use PbfFileReader
from the QuackOSM
library in the docs: https://kraina-ai.github.io/quackosm/latest/examples/pbf_file_reader/