How to save numpy array of images dataset?

Question

I am using my own dataset to train CNN. I have converted the images to a numpy array and the labels to another array. How can I save them to be able to load the data when I need to train the model? I tried pickle, but the data size is too big for it.

I am using python3.7 and tensorflow 2.1.1 .

Answer 1

There are many options to do so, one is to save it as csv file.

import numpy as np
np.savetxt("foo.csv", a, delimiter=",")

For a more efficient way, you can use HDF5 with h5py.

import h5py
h5f = h5py.File('data.h5', 'w')
h5f.create_dataset('dataset_1', data=a)