从文件中分离英文文本和非英文文本

Question

I have a.csv file and I want to separate Non-English Text and English Text in two different files. Below is the code, I tried:

  import string
  def isEnglish(s):
      return s.translate(None, string.punctuation).isalnum()
  file=open('File1.csv','r',encoding='UTF-8')
  outfile1=open('Eng.csv','w', encoding='utf-8')
  outfile2=open('Noneng.csv','w', encoding='utf-8')
  for line in file.readlines():
       r = isEnglish(line)
       if r:
          outfile1.write(line+"\n")
       else:
          outfile2.write(line+"\n")

The code is not producing the desired result. There is repetitive English text in both the files. I have attached a snapshot of one output file.

Answer 1

You neglected to mention the code produces this result:

TypeError: translate() takes exactly one argument (2 given)

Would you please Read The Fine Manual: https://docs.python.org/3/library/stdtypes.html#str.translate

The documentation offers a pretty big hint that you should call str.maketrans(... ) to create the desired translation map. This will help you identify input strings that are strictly alphanumeric.

translation_table = str.maketrans('', '', string.punctuation)