python中非英语推文的情绪分析

Question

目标：将每条推文分类为正面或负面，并将其写入输出文件，该文件将包含用户名，原始推文和推文的情绪。

码：

import re,math
input_file="raw_data.csv"
fileout=open("Output.txt","w")
wordFile=open("words.txt","w")
expression=r"(@[A-Za-z0-9]+)|([^0-9A-Za-z \t])|(\w+:\/\/\S+)"

fileAFINN = 'AFINN-111.txt'
afinn = dict(map(lambda (w, s): (w, int(s)), [ws.strip().split('\t') for ws in open(fileAFINN)]))

pattern=re.compile(r'\w+')
pattern_split = re.compile(r"\W+")
words = pattern_split.split(input_file.lower())
print "File processing started"
with open(input_file,'r') as myfile:
for line in myfile:
    line = line.lower()

    line=re.sub(expression," ",line)
    words = pattern_split.split(line.lower())
    sentiments = map(lambda word: afinn.get(word, 0), words)
    #print sentiments
    # How should you weight the individual word sentiments?
    # You could do N, sqrt(N) or 1 for example. Here I use sqrt(N)
    """
    Returns a float for sentiment strength based on the input text.
    Positive values are positive valence, negative value are negative valence.
    """
    if sentiments:
        sentiment = float(sum(sentiments))/math.sqrt(len(sentiments))
        #wordFile.write(sentiments)
    else:
        sentiment = 0
    wordFile.write(line+','+str(sentiment)+'\n')
fileout.write(line+'\n')
print "File processing completed"

fileout.close()
myfile.close()
wordFile.close()

问题：显然是output.txt文件

abc some tweet text 0
bcd some more tweets 1
efg some more tweet 0

问题1：如何在用户ID推文文本情绪之间添加逗号？ 输出应该是这样的;

 abc,some tweet text,0
 bcd,some other tweet,1
 efg,more tweets,0

问题2：推文是在Bahasa Melayu（BM），而我正在使用的AFINN词典是英文单词。 所以分类是错误的。 你知道我可以用的任何BM词典吗？

问题3：如何在JAR文件中打包此代码？

谢谢。

Answer 1

问题1：

由于fileout.write(line+'\\n') output.txt目前只是由您正在读取的行组成。 由于它是空间分隔的，你可以很容易地分开线

line_data = line.split(' ') # Split the line into a list, separated by spaces
user_id = line_data[0] # The first element of the list
tweets = line_data[1:-1] # The middle elements of the list
sentiment = line_data[-1] # The last element of the list
fileout.write(user_id + "," + " ".join(tweets) + "," + sentiment +'\n')

问题2：快速谷歌搜索给了我这个。 不确定它是否包含您需要的所有内容： https ： //archive.org/stream/grammardictionar02craw/grammardictionar02craw_djvu.txt

问题3：尝试Jython http://www.jython.org/archive/21/docs/jythonc.html