'utf-8' codec can't decode byte 0x92 in position 11: invalid start byte

Question

I am trying to convert all csv files of a folder to xlsx and using below code.

import glob
import csv
import pandas as pd
files = glob.glob('D:\cf111\*.csv')
for k in files:
    df = pd.read_csv(k)
    df.to_excel("abc.xlsx")

The code is generating the below error.

utf-8' codec can't decode byte 0x92 in position 11: invalid start byte

I cant sort out, how to resolve this error.

Answer 1

The problem might because there are contents in the csv that do not support encoding="utf-8". you can try using other encoding though.

code example:

import glob
import csv
import pandas as pd
files = glob.glob('D:\cf111\*.csv')
for k in files:
    df = pd.read_csv(k, encoding='ISO 8859-1')
    df.to_excel("abc.xlsx")

document reference: https://docs.python.org/3/library/codecs.html#standard-encodings

Answer 2

msg = email.message_from_string(str(arr[1], 'ISO 8859-1')) 使用 'ISO 8859-1' 而不是 'utf-8'