如何通过 Tensorflow 使用多个 GPU 进行单独训练？

Question

I have looked through many articles and posts about using multiple GPUs with TensorFlow. It helps me more here on "how to use parallel GPUs to train NN (neural network)". But I have a different question. Can a separate GPU be used to train different NNs at the same time?

More details:

I have neural networks A , B , and GPU1 , GPU2 . I want to train A NN on GPU1 and B NN on GPU2 at the same time. Is it possible?

Answer 1

I suggest using two separate python scripts to train both networks, such as trainA.py and trainB.py .

In the first two lines of trainA.py you select your preferred GPU.

import os
os.environ["CUDA_VISIBLE_DEVICES"] = "0"

For trainB.py you select the other GPU:

import os
os.environ["CUDA_VISIBLE_DEVICES"] = "1"

Now you should be able to run both train scripts at the same time.