有没有办法在 Pandas python 中解决这个问题——“UnicodeEncodeError: 'charmap' codec can't encode characters in position”？

Question

I have been trying to open an excel file (xlsx format and csv format) using python pandas and I am facing utf-8 encoding errors. I have also tried the encoding codes but could not solve the issue.

Kindly support me to understand and solve the issue

this is the code :

import pandas as pd
excel_file = 'Task1/Data_task1.xlsx'
data =  pd.read_excel(excel_file, encoding='utf-8', errors = 'ignore')
print(data)

Error :

File "c:\Users\nivas\Desktop\Srinivas\Internship\Dealroomo\Task1\task1.py", line 4, in <module>
    print(data)
  File "C:\Users\nivas\Anaconda3\lib\encodings\cp1252.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode characters in position 3140-3145: character maps to <undefined>

Answer 1

From my experience, Excel Text and Python do not play well together, and the many times the encoding just never works; do not know why or how.

2 Possible solutions:

1. Convert the file to CSV (.txt/.csv format) and see if you can encode it manually inside Excel.

2. Run the program on Linux Ubuntu using LibreOffice instead of Excel. Again, you will need to convert to .csv. However, LibreOffice seems to handle the encoding MUCH better than Excel. For whatever reason, Excel can refuse to convert and get rid of all the funky characters that raise Unicode Error in Python.

Best of luck