如何從包含達里語單詞的文件中刪除英語單詞？

Question

如何查找英語單詞並將其從包含達里語單詞的文件中刪除？ 我試過這段代碼，但我不知道如何改進它。

inp = open('Dari.pos', 'r')
out = open('DariNER.txt', 'w')

for line in iter(inp):
   ------------?
   out.write(word)
inp.close()
out.close()

Answer 1

您可以安裝和使用nltk庫。 這為您提供了一個英語單詞列表和一種將每一行拆分為單詞的方法：

from nltk.tokenize import word_tokenize
from nltk.corpus import words

english = words.words()

with open('Dari.pos') as f_input, open('DariNER.txt', 'w') as f_output:
    for line in f_input:
        f_output.write(' '.join(word for word in word_tokenize(line) if word.lower() not in english) + '\n')

安裝 nltk 后，您應該運行：

import nltk
nltk.download()

並用它來下載words

Answer 2

infile = "Dari.pos"
outfile = "Cleaned_English_Tags.txt"

delete_list = ['NOUN', 'ADJ', 'PUNCT', 'INTJ', 'ADV', 'VERB', 'X', 'CCONJ', 'ADP', 'AUX', 'SCONJ', 'PRON', 'DET', 'NUM', 'AU']
fin = open(infile)
fout = open(outfile, 'w')

for line in fin:
    for word in delete_list:
        line = line.replace(word, " ")
    fout.write(line)

fin.close()
fout.close()