如何让 Jupyter Docker 容器使用更多内存

Question

I'm running a jupyter/scipy-notebook Docker container. I have not restricted the memory assigned to the container with the run command.

However, what I'm seeing issuing the docker stats command is that the container is limiting its memory usage to 2 GB (on 16 GB available!), even if doing complex calculations.

How is this possible?

Answer 1

I am running Docker on Mac OS and Jupyter crashed when trying to read over 600MB CSV file. Following Andris Birkmanis instructions helped to tackle the issue by increasing the size of allocated memory for Docker.

Answer 2

Alter the resources (RAM) settings from Docker Desktop - MAC/Windows.

MAC - Docker Desktop

Preferences --> Advanced --> Change Ram Settings

Windows - Docker Desktop

Settings --> Resources --> Change the CPU / RAM / SWAP Settings

Reference: Compiled the solution from @samirko and @Andris Birkmanis. (Added Windows Solution)

Answer 3

If everything is going well, by default, docker shouldn't limit by default memory usage at all. So, your MEM USAGE / LIMIT doing docker stats [containerid] should be the same than your total memory (16Gb in your case), although it's not free but available.

Furthermore, there's no way to set by default a docker memory limit invoking dockerd ,

So, the only thing I can purpose is specify memory limit in docker run

• -m, --memory="" Memory limit (format: <number>[<unit>]). Number is a positive integer. Unit can be one of b, k, m, or g. Minimum is 4M.
• --memory-swap="" Total memory limit (memory + swap, format: <number>[<unit>]). Number is a positive integer. Unit can be one of b, k, m, or g.
• --memory-reservation="" Memory soft limit (format: <number>[<unit>]). Number is a positive integer. Unit can be one of b, k, m, or g.
• --kernel-memory="" Kernel memory limit (format: <number>[<unit>]). Number is a positive integer. Unit can be one of b, k, m, or g. Minimum is 4M.

For more information, please check Docker documentation run-time options

Check your docker run --memory-reservation=10g ... and let's see.