无法在python控制台中分配形状和数据类型为int32的数组

Question

I have been working with large datasets lately. First I was working on jupyter notebook on a windows machine where I was creating an array with shape (30072, 15484) and data type int32 and it was able to create it successfully. But when I ran the same code on the python console using the command prompt it gave a memory error. Why so?

I am running the following line pd.DataFrame(np.zeros((30000,15000),dtype=object))

Answer 1

You are using your code with dtype=object which takes more time to create than a simple int32 type. I tested your code with my PC it works fine with vscode, jupyter and cmd. Try this code:

pd.DataFrame(np.zeros((30000,15000),dtype="int32"))