简体繁体中英

Reinforcement Learning (Using Tensorflow and a Matlab Env)

原文 2021-06-13 20:59:56 4 1 python/ matlab/ ipc

I coupled a RL agent with a environment which is implemted in matlab. So I let the python script (using tensorflow V2) run, write a txt file with the actions and call the matlab environment via system command. In matlab the txt file is read, then the calculation is carried out in matlab and a result txt file is written. This txt file is then read by python, and the py script runs further.

That works, however the calculation times are relative long, one step takes between 9 and 13 seconds, although the matlab calculation need only about 1.5 -2 seconds. Therefore the training time is very high which is very annoying. Unfortunately you can't rewrite the environment to Python, would be too much work and compiling to c++ would also be rather difficult.

Is there nevertheless a better way? Does anyone have an idea how to improve that? Is there any interface between python and matlab which could help here?

Thanks in advance!

Best Chris

1 answers

I would try calling matlab from python using subprocess and setting up a stdin/out pipe. You can read all about that here or here . Writing into and reading from files (depending on your OS of course, but generally) takes much, much more time than piping data between processes. Feel free to read up on IPC (Inter Process Communication), in my opinion, stdio is the best choice for you.

Reinforcement Learning on Tensorflow without Gym

TensorFlow reinforcement learning softmax layer

Python - Using pandas with reinforcement learning

Reinforcement learning algorithm using turtle graphics not functioning

Bounding Box Refinement using Reinforcement Learning

Math quiz Application using reinforcement learning

Tensorflow Reinforcement Learning RNN returning NaN's after Optimization with GradientTape

Reinforcement learning, pendulum python

Negative reward in reinforcement learning

Time step in reinforcement learning

暂无

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

Related Question Reinforcement Learning on Tensorflow without Gym TensorFlow reinforcement learning softmax layer Python - Using pandas with reinforcement learning Reinforcement learning algorithm using turtle graphics not functioning Bounding Box Refinement using Reinforcement Learning Math quiz Application using reinforcement learning Tensorflow Reinforcement Learning RNN returning NaN's after Optimization with GradientTape Reinforcement learning, pendulum python Negative reward in reinforcement learning Time step in reinforcement learning

Related Tags

Reinforcement Learning (Using Tensorflow and a Matlab Env)

Question

1 answers

solution1 2 2021-06-13 21:14:35

solution1
2 2021-06-13 21:14:35