我试图在我的数据集上微调 VGG16，但遇到了关于加载 VGG16 权重的 OSError

Question

I tried to fine-tune VGG16 on my dataset, but stuck on trouble of opening h5py file of VGG16-weights. I don't understand what does this error mean about:

OSError: Unable to open file (Truncated file: eof = 221184, sblock->base_addr = 0, stored_eoa = 58889256)

Does anyone know how to fix it? thanks

---------------------------------------------------------------------------
OSError                                   Traceback (most recent call last)
<ipython-input-3-6059faca8ed7> in <module>()
      9     K.set_session(sess)
     10     input_tensor=Input(shape=(h,w,ch))
---> 11     base_model=VGG16(input_tensor=input_tensor, include_top=False)
     12     x_img=base_model.output
     13     x_img=AveragePooling2D((7,7))(x_img)

/Users/simin/anaconda/envs/IntroToTensorFlow/lib/python3.5/site-packages/keras/applications/vgg16.py in VGG16(include_top, weights, input_tensor)
    144                                         TF_WEIGHTS_PATH_NO_TOP,
    145                                         cache_subdir='models')
--> 146             model.load_weights(weights_path)
    147             if K.backend() == 'theano':
    148                 convert_all_kernels_in_model(model)

/Users/simin/anaconda/envs/IntroToTensorFlow/lib/python3.5/site-packages/keras/engine/topology.py in load_weights(self, filepath, by_name)
   2492         '''
   2493         import h5py
-> 2494         f = h5py.File(filepath, mode='r')
   2495         if 'layer_names' not in f.attrs and 'model_weights' in f:
   2496             f = f['model_weights']

/Users/simin/anaconda/envs/IntroToTensorFlow/lib/python3.5/site-packages/h5py/_hl/files.py in __init__(self, name, mode, driver, libver, userblock_size, swmr, **kwds)
    270 
    271                 fapl = make_fapl(driver, libver, **kwds)
--> 272                 fid = make_fid(name, mode, userblock_size, fapl, swmr=swmr)
    273 
    274                 if swmr_support:

/Users/simin/anaconda/envs/IntroToTensorFlow/lib/python3.5/site-packages/h5py/_hl/files.py in make_fid(name, mode, userblock_size, fapl, fcpl, swmr)
     90         if swmr and swmr_support:
     91             flags |= h5f.ACC_SWMR_READ
---> 92         fid = h5f.open(name, flags, fapl=fapl)
     93     elif mode == 'r+':
     94         fid = h5f.open(name, h5f.ACC_RDWR, fapl=fapl)

h5py/_objects.pyx in h5py._objects.with_phil.wrapper (/Users/ilan/minonda/conda-bld/work/h5py/_objects.c:2696)()

h5py/_objects.pyx in h5py._objects.with_phil.wrapper (/Users/ilan/minonda/conda-bld/work/h5py/_objects.c:2654)()

h5py/h5f.pyx in h5py.h5f.open (/Users/ilan/minonda/conda-bld/work/h5py/h5f.c:1942)()

OSError: Unable to open file (Truncated file: eof = 221184, sblock->base_addr = 0, stored_eoa = 58889256)

Answer 1

There is a possibility that the download of the file has failed.

Replacing a file that failed to open with the following file may resolve it. https://github.com/fchollet/deep-learning-models/releases

My situation, That file was in the following path. C:\\Users\\MyName\\.keras\\models\\vgg16_weights_tf_dim_ordering_tf_kernels.h5

I replaced it and solved it.

Answer 2

because the last time you file download is failed.but the bad file remains in the filepath. so you have to find the bad file. maybe u can use “find / -name 'vgg16_weights_tf_dim_ordering_tf_kernels_notop.h5'” to find the path in unix-system. then delete it try agian!good luck!!

Answer 3

It is probably because the file download failed or the file is corrupt.

I found those corrupted files in /tmp/.keras/models/vggface/ .

My system is Ubuntu 20.04.