Unicode解码错误：如何跳过无效字符

Question

有什么方法可以预处理文本文件并跳过这些字符？

UnicodeDecodeError: 'utf8' codec can't decode byte 0xa1 in position 1395: invalid start byte

Answer 1

尝试这个：

str.decode('utf-8',errors='ignore')

Answer 2

I think your text file have some special character, so 'utf-8' can't decode.

You need to try using 'ISO-8859-1' instead of 'utf-8'. like this:

   import sys
   reload(sys).setdefaultencoding("ISO-8859-1")

   # put your code here