UnicodeEncodeError：'ascii'编解码器不能编码字符u'\\ xef'

Question

我正在取消亚马逊客户评论。 它运行了一段时间，但在某一点之后，我得到了这个错误。

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "custreviewscrap.py", line 73, in <module>
    strcomment = str(k.getText())
UnicodeEncodeError: 'ascii' codec can't encode character u'\xef' in position 293
7: ordinal not in range(128)

我试过跟踪但不起作用......

1)strcomment = `str(k.getText()).encode('utf8')`
2)strcomment = str(k.getText())
  strcomment = strcomment.encode('ascii', 'ignore')

非常感谢你！

for k in bsreview2.findAll('div',{"style":"margin-left:0.5em;"}):
    #next part is clean the comments. sorry, this part is really dirty, I should have written a function
    #the comment is surrounded by different stuff depends on what kind of review it is, video or pics or text
    strcomment = str(k.getText())
    patcomment = re.compile(r'(.*(\(Electronics\)|\(Health and Beauty\)))')
    patcomment2 = re.compile(r'Help other customers find.*')
    patcomment3 = re.compile(r'(Customer review from the Amazon Vine Program(.|\n)*Length::)|(\<\!(.|\n)*Length::)|(Customer review from the Amazon Vine Program\(What\'s this\?\)|(.*See all my reviews))')

    cleancomment = re.sub(patcomment, '', strcomment)
    cleancomment = re.sub('&nbsp;', '', cleancomment)
    cleancomment = re.sub(patcomment2, '', cleancomment)
    cleancomment = re.sub(',' ,'.', cleancomment)
    cleancomment = re.sub(patcomment3, '', cleancomment)
    strdate = str(k.nobr.getText())
    cleandate = re.sub(',','',strdate)

    print (k.span.getText())[0:1]+','+ cleandate +',' + cleancomment
    csvtext = csvtext + (k.span.getText())[0:1]+','+ cleandate +',' + a +','+ cleancomment + '\n'

Answer 1

假设k.getText()返回Unicode，则以下方法可行（其中s是k.getText()的结果）：

>>> s = u'\xef'
>>> s.encode('utf-8')
'\xc3\xaf'

请注意，不再需要str()调用。