docker 容器無法停止或 rm 因為 OSError: [Errno 12] 無法分配 memory

Question

獲取容器日志：

2021-12-23 06:32:00.526 6 ERROR cinder Traceback (most recent call last):
2021-12-23 06:32:00.526 6 ERROR cinder   File "/var/lib/kolla/venv/bin/cinder-volume", line 8, in <module>
2021-12-23 06:32:00.526 6 ERROR cinder     sys.exit(main())
2021-12-23 06:32:00.526 6 ERROR cinder   File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/cmd/volume.py", line 199, in main
2021-12-23 06:32:00.526 6 ERROR cinder     _launch_services_posix()
2021-12-23 06:32:00.526 6 ERROR cinder   File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/cmd/volume.py", line 170, in _launch_services_posix
2021-12-23 06:32:00.526 6 ERROR cinder     launcher.wait()
2021-12-23 06:32:00.526 6 ERROR cinder   File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/service.py", line 659, in wait
2021-12-23 06:32:00.526 6 ERROR cinder     self._respawn_children()
2021-12-23 06:32:00.526 6 ERROR cinder   File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/service.py", line 646, in _respawn_children
2021-12-23 06:32:00.526 6 ERROR cinder     self._start_child(wrap)
2021-12-23 06:32:00.526 6 ERROR cinder   File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/service.py", line 565, in _start_child
2021-12-23 06:32:00.526 6 ERROR cinder     pid = os.fork()
2021-12-23 06:32:00.526 6 ERROR cinder OSError: [Errno 12] Cannot allocate memory
2021-12-23 06:32:00.526 6 ERROR cinder

現在OOM已經修復，所以hypervisor的memory就足夠了。 但是我無法restart或stop容器，執行 docker 命令沒有任何錯誤或更新日志，容器顯示始終在運行。

# docker ps -a|grep cinder_volume
d***c    ubuntu-source-cinder-volume:train    "dumb-init --single-…"    19 months ago    Up 15 months    cinder_volume

# docker rm cinder_volume
Error response from daemon: You cannot remove a running container d*****. Stop the container before attempting removal or force remove

問題：

• 1、如何在不重啟dockerd的情況下重啟cinder_volume容器？
• 2、為什么容器的日志不會像往常一樣更新，一直停留在ERROR cinder OSError: [Errno 12] Cannot allocate memory ？

Answer 1

1、如何在不重啟dockerd的情況下重啟cinder_volume容器？

docker restart <container name or ID> --time 30

2、為什么容器的日志不會像往常一樣更新卡在ERROR cinder OSError: [Errno 12] Cannot allocate memory？

應用程序無法從上一個錯誤中恢復並停止處理。 您的機器似乎用完了 memory。