kube.netes 可以在 pod 之间共享单个 GPU 吗？

Question

Is there a possibility to share a single GPU between kube.netes pods?

Answer 1

As the official doc says

GPUs are only supposed to be specified in the limits section, which means:

You can specify GPU limits without specifying requests because Kubernetes will use the limit as the request value by default.

You can specify GPU in both limits and requests but these two values must be equal.

You cannot specify GPU requests without specifying limits. Containers (and pods) do not share GPUs . There's no overcommitting of GPUs.

Each container can request one or more GPUs. It is not possible to request a fraction of a GPU.

Also, you can follow this discussion to get a little bit more information.

Answer 2

Yes, it is possible - at least with Nvidia GPUs.

Just don't specify it in the resource limits/requests. This way containers from all pods will have full access to the GPU as if they were normal processes.

Answer 3

是的，可以通过对调度程序进行一些更改，github 上有人好心地开源了他们的解决方案，请看这里： https : //github.com/AliyunContainerService/gpushare-scheduler-extender

Answer 4

Yes, you can use nano gpu for sharing gpu of nvidia.

Answer 5

Official docs says pods can't request fraction of CPU. If you are running machine learning application in multiple pods then you have to look into kubeflow. Those guys have solved this issue.