[英]Creating a dictionary of words and their context in a sentence
I have a Python list containing hundreds of thousands of words. 我有一个包含数十万个单词的Python列表。 The words appear in the order they are in the text.
单词按文本中的顺序显示。
I'm looking to create a dictionary of each word associated with a string containing that word with 2 (say) words that appear before and after it. 我希望创建一个与包含该单词的字符串相关联的每个单词的字典,其中包含出现在其前后的2个(例如)单词。
For example the list: "This" "is" "an" "example" "sentence" 例如列表:“这”“是”“一个”“例子”“句子”
Should become the dictionary: 应该成为字典:
"This" = "This is an"
"is" = "This is an example"
"an" = "This is an example sentence"
"example" = "is an example sentence"
"sentence" = "an example sentence"
Something like: 就像是:
WordsInContext = Dict()
ContextSize = 2
wIndex = 0
for w in Words:
WordsInContext.update(w = ' '.join(Words[wIndex-ContextSize:wIndex+ContextSize]))
wIndex = wIndex + 1
This may contain a few syntax errors, but even if those were corrected, I'm sure it would be a hideously inefficient way of doing this. 这可能包含一些语法错误,但即使这些错误已得到纠正,我也相信这将是一种非常低效的方法。
Can someone suggest a more optimized method please? 有人可以提出更优化的方法吗?
My suggestion: 我的建议:
words = ["This", "is", "an", "example", "sentence" ]
dict = {}
// insert 2 items at front/back to avoid
// additional conditions in the for loop
words.insert(0, None)
words.insert(0, None)
words.append(None)
words.append(None)
for i in range(len(words)-4):
dict[ words[i+2] ] = [w for w in words[i:i+5] if w]
>>> from itertools import count
>>> words = ["This", "is", "an", "example", "sentence" ]
>>> context_size = 2
>>> dict((word,words[max(i-context_size,0):j]) for word,i,j in zip(words,count(0),count(context_size+1)))
{'This': ['This', 'is', 'an'], 'is': ['This', 'is', 'an', 'example'], 'sentence': ['an', 'example', 'sentence'], 'example': ['is', 'an', 'example', 'sentence'], 'an': ['This', 'is', 'an', 'example', 'sentence']}
In python 2.7+
or 3.x
在python
2.7+
或3.x
{word:words[max(i-context_size,0):j] for word,i,j in zip(words,count(0),count(context_size+1))}
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.