[英]UnicodeEncodeError: 'ascii' codec can't encode character u'\xef'
I am scrapping Amazon customer review. 我正在取消亚马逊客户评论。 It runs a while but after certain point, I get this error. 它运行了一段时间,但在某一点之后,我得到了这个错误。
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "custreviewscrap.py", line 73, in <module>
strcomment = str(k.getText())
UnicodeEncodeError: 'ascii' codec can't encode character u'\xef' in position 293
7: ordinal not in range(128)
I tried following things but didn't work... 我试过跟踪但不起作用......
1)strcomment = `str(k.getText()).encode('utf8')`
2)strcomment = str(k.getText())
strcomment = strcomment.encode('ascii', 'ignore')
Thank you very much! 非常感谢你!
for k in bsreview2.findAll('div',{"style":"margin-left:0.5em;"}):
#next part is clean the comments. sorry, this part is really dirty, I should have written a function
#the comment is surrounded by different stuff depends on what kind of review it is, video or pics or text
strcomment = str(k.getText())
patcomment = re.compile(r'(.*(\(Electronics\)|\(Health and Beauty\)))')
patcomment2 = re.compile(r'Help other customers find.*')
patcomment3 = re.compile(r'(Customer review from the Amazon Vine Program(.|\n)*Length::)|(\<\!(.|\n)*Length::)|(Customer review from the Amazon Vine Program\(What\'s this\?\)|(.*See all my reviews))')
cleancomment = re.sub(patcomment, '', strcomment)
cleancomment = re.sub(' ', '', cleancomment)
cleancomment = re.sub(patcomment2, '', cleancomment)
cleancomment = re.sub(',' ,'.', cleancomment)
cleancomment = re.sub(patcomment3, '', cleancomment)
strdate = str(k.nobr.getText())
cleandate = re.sub(',','',strdate)
print (k.span.getText())[0:1]+','+ cleandate +',' + cleancomment
csvtext = csvtext + (k.span.getText())[0:1]+','+ cleandate +',' + a +','+ cleancomment + '\n'
Assuming k.getText()
returns Unicode, the following would work (where s
is the result of k.getText()
): 假设k.getText()
返回Unicode,则以下方法可行(其中s
是k.getText()
的结果):
>>> s = u'\xef'
>>> s.encode('utf-8')
'\xc3\xaf'
Note that a str()
call isn't needed anymore. 请注意,不再需要str()
调用。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.