热图标签和 python pandas dataframe 中的位置

Question

I have Pandas Dataframe as below

newdf[['name_left','text']]

from each text column I would like to extract every hashtag and create heatmap with name_left on X axis and extracted hashtag on Y axis

I can perform count of each hashtag using code below

newdf.text.str.extractall(r'(#\w+)').reset_index(level=0).drop_duplicates()[0].value_counts()

unfortunately im struggling to add name_left and later create heatmap to see correlations

Answer 1

I think what you want is this

import pandas as pd
df = pd.DataFrame({'name_left': ['Canada', 'Peru'],
                   'text': ['asdf #broccoli sadfsd #milk', 'sdfsd #king bbas #toast']})

df = df.groupby(['name_left']).apply(lambda x: x.text.str.extractall(r'(#\w+)').reset_index(level=0).drop_duplicates()[0].value_counts())

print(df)

Canada     #milk        1
           #broccoli    1
Peru       #king        1
           #toast       1
Name: 0, dtype: int64