dataframe：pd.read_csv 错误

Question

I have a huge text file that I read by pd.read_csv. But it can't read a special line in the dataframe and return Nan values for that line. I got that if I add a space to the line, everything works well. But I can't do this since the format of my text file can't be changed at all. Does anyone work with large text files and faced the same problem?

I think here it's not possible to send a file, but if you think that you can find a solution, I can send my file and code by email to you.

Thanks in advance.

Answer 1

It's hard to understand without an example of the file you're handling with. But, if you know the index of that line you can just pass a skiprows argument when reading the csv so that line would not be read to the dataframe.

ie if the line you need to skip is in index 4:

df = pd.read_csv('file.csv', skiprows=4)