如何使用 Pandas 在 DataFrame 中查找單詞列表的頻率

Question

我的df看起來像這樣：

category       text_list
--------       ---------
soccer         [soccer, game, is, good, soccer, game]
basketball     [game, basketball, game]
volleyball     [sport ,volleyball, sport] 

我想做的是按category groupby ，然后按frequency列出words

category       text_list          frequency
--------       ---------          ---------
soccer         soccer             2
               game               2 
               is                 1
               good               1
basketball     game               2
               basketball         1  
volleyball     sport              2
               volleyball         1

我做了什么？

• 我能夠找到每行的frequency ，但我無法按照我在 DataFrame 中想要的方式DataFrame

有人可以幫我嗎？ 如果可能的話，使用NLTK

Answer 1

嘗試explode然后groupby ：

(df.explode('text_list')
   .groupby(['category','text_list']).size()
   .to_frame(name='frequency')
)

Output：

                       frequency
category   text_list            
basketball basketball          1
           game                2
soccer     game                2
           good                1
           is                  1
           soccer              2
volleyball sport               2
           volleyball          1