将句子拆分为单词 pandas 并保留标签

Question

I have a Pandas dataframe like

Text                  label      value
board members         A1          NaN
a really long sent    A2          B2

Result: I would like to unnest the sentences and keep each label per word-split, like this

Sentence    Text         label      value
   1        board          A1        NaN
   1        members        A1        NaN
   2          a            A2        B2
   2        really         A2        B2 
   2         long          A2        B2 
   2         sent          A2        B2

Extra: If possible, I would like to extract a POS (Part of Speech) tagging of each word in a new column_

Sentence    Text         label      value    POS
   1        board          A1        NaN     Something
   1        members        A1        NaN     Something
   2          a            A2        B2      Something
   2        really         A2        B2      etc
   2         long          A2        B2 
   2         sent          A2        B2

Answer 1

You can convert Text to list then explode :

df['Text'] = df['Text'].str.split()
df = df.explode("Text")

print(df)

      Text        label value
0    board  A1            NaN
0  members  A1            NaN
1        a  A2             B2
1   really  A2             B2
1     long  A2             B2
1     sent  A2             B2