[英]Problem extracting OSRM data using Docker
我正在尝试提取 OSRM 数据但遇到了麻烦。 在上一个问题中（ lua error when trying to extract osrm data ），我遇到了一个错误。 因此，除了 Docker 之外，我没有尝试做同样的事情。我正在使用带有硅芯片的较新 Mac。 我首先安装了 Docker ( https://docs.docker.com/desktop/install/mac-install/;然后在终端docker pull osrm/osrm-backend )。 我从https://download.geofabrik.de/north-america.html下载北美数据。 我已经为实例和几个内核分配了 50GB 的 memory。 如果在终端中运行docker run -t -v /Users/[name]/osrm-backend/docker:/data osrm/osrm-backend osrm-extract -p /opt/car.lua /data/north-america-latest.osm.pbf ，我得到：
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
[info] Parsed 0 location-dependent features with 0 GeoJSON polygons
[info] Using script /opt/car.lua
[info] Input file: north-america-latest.osm.pbf
[info] Profile: car.lua
[info] Threads: 5
[info] Parsing in progress..
[info] input file generated by osmium/1.14.0
[info] timestamp: 2023-01-05T21:21:39Z
[info] Using profile api version 4
[info] Found 3 turn restriction tags:
[info] motorcar
[info] motor_vehicle
[info] vehicle
[info] Parse relations ...
TBB Warning: Exact exception propagation is requested by application but the linked library is built without support for it
terminate called after throwing an instance of 'tbb::captured_exception'
what(): PBF error: truncated data (EOF encountered)
qemu: uncaught target signal 6 (Aborted) - core dumped
该进程可能仍在运行（这意味着我无法执行任何新命令），但显然已经有一段时间没有做任何事情了。
这些警告是什么意思，我该如何解决？
另请注意，如果我运行另一个文件，它会起作用。 docker run -t -v /Users/[name]/osrm-backend/docker:/data osrm/osrm-backend osrm-extract -p /opt/car.lua /data/us-virgin-islands-latest.osm.pbf
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
[info] Parsed 0 location-dependent features with 0 GeoJSON polygons
[info] Using script /opt/car.lua
[info] Input file: us-virgin-islands-latest.osm.pbf
[info] Profile: car.lua
[info] Threads: 5
[info] Parsing in progress..
[info] input file generated by osmium/1.14.0
[info] timestamp: 2023-01-05T21:21:39Z
[info] Using profile api version 4
[info] Found 3 turn restriction tags:
[info] motorcar
[info] motor_vehicle
[info] vehicle
[info] Parse relations ...
[info] Parse ways and nodes ...
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Using profile api version 4
[info] Parsing finished after 4.90155 seconds
[info] Raw input contains 1316532 nodes, 72554 ways, and 97 relations, 30 restrictions
[info] Collecting way information on 30 restrictions...ok, after 0.000596s
[info] Collecting way information on 0 maneuver overrides...ok, after 0.000106s
[info] Sorting used nodes ... ok, after 0.004332s
[info] Erasing duplicate nodes ... ok, after 0.000402s
[info] Sorting all nodes ... ok, after 0.002219s
[info] Building node id map ... ok, after 0.00384s
[info] Confirming/Writing used nodes ... ok, after 0.111959s
[info] Writing barrier nodes ... ok, after 0s
[info] Writing traffic light nodes ... ok, after 0s
[info] Processed 73181 nodes
[info] Sorting edges by start ... ok, after 0.006168s
[info] Setting start coords ... ok, after 0.010829s
[info] Sorting edges by target ... ok, after 0.006618s
[info] Computing edge weights ... ok, after 0.111005s
[info] Sorting edges by renumbered start ... ok, after 0.01132s
[info] Writing used edges ... ok, after 0.013881s -- Processed 75963 edges
[info] Writing way meta-data ... ok, after 0.001686s -- Metadata contains << 9487 entries.
[info] Collecting node information on 0 maneuver overrides...ok, after 8e-06s
[info] Collecting node information on 30 restrictions...ok, after 0.000959s
[info] writing street name index ... ok, after 0.004272s
[info] extraction finished after 5.21655s
[info] Generating edge-expanded graph representation
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
[info] Node compression ratio: 0.19777
[info] Edge compression ratio: 0.220645
[info] graph compression removed 8425 annotations of 9487 in 0.014951 seconds
[info] Find segregated edges in node-based graph ...
[info] ok, after 0.426069s
[info] Segregated edges count = 57
[info] Writing nodes for nodes-based and edges-based graphs ...
[info] Geometry successfully removed:
compressed edges: 33300
compressed geometries: 150658
longest chain length: 151
cmpr ratio: 0.22103
avg chain length: 4.52426
[info] Removing invalid restrictions...removed 0 invalid restrictions, after 0.000302s
[info] Constructing restriction graph on 30 restrictions...ok, after 0.001196s
[info] Generating edge expanded nodes ...
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
[info] Expanding via-way turn restrictions ...
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% 100%
[info] Generated 32790 nodes (5 of which are duplicates) and 75329 segments in edge-expanded graph
[info] Generating edge-expanded edges
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% .
[info] Sorting and writing 0 maneuver overrides...
[info] done.
[info] Renumbering turns
[info] Writing 0 conditional turn penalties...
[info] Generated 75329 edge based node segments
[info] Node-based graph contains 32735 edges
[info] Edge-expanded graph ...
[info] contains 61286 edges
[info] Timing statistics for edge-expanded graph:
[info] Renumbering edges: 0.001581s
[info] Generating nodes: 0.01637s
[info] Generating edges: 0.7993s
[info] Generating guidance turns
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% .
[info] done.
[info] Created 26 entry classes and 1550 Bearing Classes
[info] Handled: 0 of 13 lanes: 0 %.
[info] Assigned 68762 turn instruction types:
[info] new name: 3076 (4.47%)
[info] continue: 5507 (8.01%)
[info] turn: 27959 (40.66%)
[info] merge: 21 (0.03%)
[info] on ramp: 5 (0.01%)
[info] off ramp: 8 (0.01%)
[info] fork: 832 (1.21%)
[info] end of road: 10601 (15.42%)
[info] notification: 4 (0.01%)
[info] enter roundabout: 6 (0.01%)
[info] enter roundabout turn: 11 (0.02%)
[info] (noturn): 4261 (6.20%)
[info] (suppressed): 16403 (23.85%)
[info] exit roundabout: 8 (0.01%)
[info] exit roundabout turn: 11 (0.02%)
[info] (stay on roundabout): 19 (0.03%)
[info] (sliproad): 30 (0.04%)
[info] Assigned 68762 turn instruction modifiers:
[info] uturn: 5105 (7.42%)
[info] sharp right: 2730 (3.97%)
[info] right: 16456 (23.93%)
[info] slight right: 2962 (4.31%)
[info] straight: 19307 (28.08%)
[info] slight left: 2989 (4.35%)
[info] left: 16526 (24.03%)
[info] sharp left: 2687 (3.91%)
[info] Guidance turn annotations took 1.18582s
[info] Writing Intersection Classification Data
[info] ok, after 0.00886s
[info] Writing Turns and Lane Data...
[info] ok, after 0.01241s
[info] Saving edge-based node weights to file.
[info] Done writing. (0.005628)
[info] Computing strictly connected components ...
[info] Found 64 SCC (2 large, 62 small)
[info] SCC run took: 0.00466692s
[info] Building r-tree ...
[info] Constructing r-tree of 75329 segments build on-top of 73181 coordinates
[info] finished r-tree construction in 0.149264 seconds
[info] Writing edge-based-graph edges ...
[info] ok, after 0.121746s
[info] Processed 61286 edges
[info] Expansion: 26516 nodes/sec and 11881 edges/sec
[info] To prepare the data for routing, run: ./osrm-contract "/data/us-virgin-islands-latest.osrm"
[info] RAM: peak bytes used: 183009280
可能是memory的问题，多分配试试。 正如有人在本期https://github.com/Project-OSRM/osrm-backend/issues/5614#issuecomment-560504788中提到的：
我唯一真正的参考点是处理北美需要大约 100GB 的 RAM。
无法在 Ubuntu 中使用 docker 将 OSRM 前端与 OSRM 后端连接起来
[英]Not able to connect OSRM frontend with OSRM backend using docker in Ubuntu
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.