在熊猫中读取带有额外行的csv文件

Question

I'm trying to use pandas to manipulate a .txt file but I have extraline as shown in the picture below:

When i read the file

import pandas as pd

df=pd.read_csv('movies.txt',sep='|')
print(df)

I got this as an output:

                                                          +--------+--------------------------+------------+---------------+
NaN                                                id       MovieNAme                  Year         Author                                                         NaN       

+--------+--------------------------+----------... NaN      NaN                        NaN          NaN                                                            NaN       

NaN                                                1234     once upon deadpool                 2017 Alicia                                                         NaN       

+--------+--------------------------+----------... NaN      NaN                        NaN          NaN                                                            NaN       

NaN                                                1244     avengers: endgame                  2014 John                                                           NaN       

+--------+--------------------------+----------... NaN      NaN                        NaN          NaN                                                            NaN       

NaN                                                1245     The bird King                      2017 Mark                                                           NaN       

+--------+--------------------------+----------... NaN      NaN                        NaN          NaN                                                            NaN   

How can i fix this please and remove this line "---------------------+----------"

Answer 1

Try:

df = pd.read_csv(
    "name_of_your_file.txt",
    sep=r"\s*\|\s*",
    comment="+",
    usecols=range(1, 5),
    engine="python",
)
print(df)

Answer 2

Usually, when working with csv we create empty spaces but pandas consider it as a line. do it's always better to add DataFrameName.dropna(axis=0, inplace=False) to drop those empty cells or you can just go to csv and do it manually.