[英]Is there a way to speed up this for in python?
有没有办法加速 python 中的这段代码? 我需要用超过 500k 的字符串来运行它,而且时间太长了。
每个单词都需要放入匹配的字典中。
example_sent_words = 500k 个字符串的列表
EmojiPos = 表情符号列表
EmojiNeg = 表情符号列表
OthersEmoji = 表情符号列表
emoji_pos=dict()
emoji_neg=dict()
emoji_others=dict()
for w in example_sent_words:
if w in s_EmojiPos:
remove_username_url.remove(w)
if w in emoji_pos:
emoji_pos[w] += 1
else:
emoji_pos[w] = 1
elif w in s_EmojiNeg:
remove_username_url.remove(w)
if w in emoji_neg:
emoji_neg[w] += 1
else:
emoji_neg[w] = 1
elif w in s_OthersEmoji:
remove_username_url.remove(w)
if w in emoji_others:
emoji_others[w] += 1
else:
emoji_others[w] = 1
编辑:我按照建议写了这个:
s_AdditionalEmoji = set(AdditionalEmoji)
s_EmojiNeg = set(EmojiNeg)
s_EmojiPos = set(EmojiPos)
为了减少 memory 的使用并加快检查速度并确保检查每个单词,我建议:
word_count = len(example_sent_words)
for i in range(word_count) :
w = example_sent_words[0]
if w in EmojiPos:
example_sent_words.pop(0)
try:
emoji_pos[w] += 1
except:
emoji_pos[w] = 1
elif w in EmojiNeg:
example_sent_words.pop(0)
try:
emoji_neg[w] += 1
except:
emoji_neg[w] = 1
elif w in OthersEmoji:
example_sent_words.pop(0)
try:
emoji_others[w] += 1
except:
emoji_others[w] = 1
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.