简体   繁体   English

应该使用哪个 OpenAI 健身房环境来解决最短路线问题?

[英]Which OpenAI gym environment should be used for solve the shortest route problem?

I am trying to fine the shortest route between two nodes using reinforcement learning.我正在尝试使用强化学习来确定两个节点之间的最短路线。 I am not sure what environment to use.我不确定要使用什么环境。 I have found this particular environment and am not sure if I am going in the right direction.我发现了这个特殊的环境,但不确定我是否朝着正确的方向前进。 Can anybody please help.任何人都可以帮忙。 Can anybody please suggest a few python OpenAI gym environments I can use.任何人都可以建议一些我可以使用的 python OpenAI 健身房环境。

I am trying to do the same things too.我也在尝试做同样的事情。 But currently, none of open-sourced OpenAI gym environments is applicable.但目前,没有一个开源的 OpenAI 健身房环境是适用的。 So I suggest you create your own environment (it is not too hard).所以我建议你创建自己的环境(这并不难)。 Here is what I found:这是我发现的:

  1. https://github.com/hubbs5/or-gym They have multiple environments for combinatorial optimization, but all environments have fixed formats. https://github.com/hubbs5/or-gym他们有多种组合优化的环境,但是所有环境都有固定的格式。 So if you want to use your own graph this might not be suitable.因此,如果您想使用自己的图表,这可能不合适。
  2. https://github.com/Velythyl/route-gym It can use your own.network graph as an environment and the graph can be weighted. https://github.com/Velythyl/route-gym可以使用自己的.network graph作为环境,并且可以对graph进行加权。 But it will take a long time to initialize the graph since they are trying to find out all possible paths to build a reward function metric.但是初始化图表需要很长时间,因为他们试图找出所有可能的路径来构建奖励 function 指标。 So a large graph is not able to use in this env.所以在这个环境中无法使用大图。 Also, check_env in stablebaseline3 for this environment will warn you the state / observation_space for step() and reset() are not work well.此外,此环境的 stablebaseline3 中的check_env会警告您state / observation_spacestep()reset()无法正常工作。
  3. https://github.com/pmarszal/AIRouting This environment can work for most of the simple graphs. https://github.com/pmarszal/AIRouting此环境适用于大多数简单图形。 But it did not consider the weights of each edge in the graph.但它没有考虑图中每条边的权重。
  4. https://core.ac.uk/download/pdf/334949709.pdf The OpenGraphGym. https://core.ac.uk/download/pdf/334949709.pdf OpenGraphGym。 It seems to be an ideal solution for our problem, but I can't find its open-source code.它似乎是我们问题的理想解决方案,但我找不到它的开源代码。
  5. https://github.com/dnoursi/gym-graph-search It can only give you randomly generated graph with no weights. https://github.com/dnoursi/gym-graph-search它只能给你随机生成的图,没有权重。
  6. https://github.com/dyllanwli/GraphRouteOptimizationRL/tree/master/src/gym_graph_map Here is what I am trying to do: use a real-world map provider Osmnx (in a.network format) to generate an environment to let the agent find the best route with custom weights (not finish yet) https://github.com/dyllanwli/GraphRouteOptimizationRL/tree/master/src/gym_graph_map以下是我正在尝试做的事情:使用真实世界的 map 提供商 Osmnx(以.network 格式)生成一个环境让代理找到具有自定义权重的最佳路线(尚未完成)

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM