读取 CSV 文件，该文件使用双引号分隔列中的值，并使用逗号分隔 Python 中的列

Question

There's a file that uses comma's to separate columns as well as indicate empty column values. Moreover, in the same file double quotes are used to separate field values, where commas are being used to separate the values within the field. If column has only single value, double quotes are not being used.

Example:

col1,col2,col3,col4,col5,col6
name, age,,,"cat,dog", year
name,age,weight,height,cat,year
"first name,last name",age, weight,,"dog, cat, another dog",,

Expected result

col1	col2	col3	col4	col5	col6
name	age			dog, cat	year
name	age	weight	height	cat	year
first name, last name	age	weight		dog, cat, another dog

Another important thing, if that matters, is that the CSV uses Windows-1252 encoding .

Answer 1

Your CSV is not in the right format. You have an extra comma at the end of last row. If you remove that extra comma this code will work:

import pandas as pd

df = pd.read_csv('data/test_data.txt', quotechar='"', delimiter=',')
print(df)

The output is this:

                   col1  col2     col3    col4                   col5   col6
0                  name   age      NaN     NaN                cat,dog   year
1                  name   age   weight  height                    cat   year
2  first name,last name   age   weight     NaN  dog, cat, another dog    NaN