在不使用 nltk 的情况下删除文本文件中的停用词

Question

hi everybody i want to remove stop words in a text file without using nltk. I have a text file has stop words list for stopping, i want use the stop words list mentioned above. thank you

Answer 1

Although hard to understand the exact requirements, I would do something as follows:

with open("stopwords.txt") as f:
    stopwords = f.read().splitlines() # Contains "and" and "or" on different lines

text = "Foo and bar or foo"
tokens = text.split() # Split into list of words
for word in tokens: 
    if word.lower() in stopwords: # If word in stopwords remove it
        tokens.remove(word)
clean_text = " ".join(word for word in tokens) # Join words into a string
print(clean_text) # Outputs: "Foo bar foo"