在Python和UnicodeDecodeError中读取大型Excel文件：

Question

I am new to Python and I'm trying to read a large excel file in python. I converted my xlsx file to csv to work with pandas. I wrote the code below:

import pandas as pd
pd.read_csv('filepath.csv')
df = csv.parse("Sheet")
df.head()

But it gives this error: UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 28: character maps to <undefined>

Can you please tell me why it gives this error? Or do you have any advice to read large excel files? I also tried to work with openpyxl module, but I couldn't use read_only because of version of my Python.(I am using Python 2.7.8)

Answer 1

Save the excel into Unicode Text File with Microsoft Excel.

Open the file with this line:

df = pd.read_csv(filename,sep='\t',encoding='utf-16-le')
print(df.head())

Answer 2

Try with

pd.read_csv('filepath.csv',encoding ='utf-8')

There are many other encoding techniques like encoding = 'iso-8859-1' or encoding = 'cp1252' or encoding = 'latin1' . You can choose as per your requirement.