[英]Get the top term per document - scikit tf-idf
在Ami的最后两个步骤中,只需添加另一种方法即可:
# Get a list of all the keywords by calling function
feature_names = np.array(count_vect.get_feature_names())
feature_names[X_train_tfidf.argmax(axis=1)]
假设您从数据集开始:
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.feature_extraction.text import TfidfTransformer
import numpy as np
from sklearn.datasets import fetch_20newsgroups
d = fetch_20newsgroups()
使用计数向量化器和tfidf:
count_vect = CountVectorizer()
X_train_counts = count_vect.fit_transform(d.data)
transformer = TfidfTransformer()
X_train_tfidf = transformer.fit_transform(X_train_counts)
现在您可以创建一个逆映射:
m = {v: k for (k, v) in count_vect.vocabulary_.items()}
这给出了每个文档有影响力的词:
[m[t] for t in np.array(np.argmax(X_train_tfidf, axis=1)).flatten()]
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.