檢查多個工作表中是否存在一個單詞

Question

我有以下格式的數據框：

示例數據框：

row1:['efcc', 'fficial', 'billiontwits', 'since', 'covid', 'landed']
row2:['when', 'people', 'say', 'the', 'fatality', 'rate', 'of', 'coronavirus', 'is']
row3:['in', 'the', 'coronavirus-induced', 'crisis', 'people', 'are',  'cyvbwx']
row4:['in', 'the', 'be-induced', 'crisis', 'people', 'are',  'cyvbwx']

columns2(sheet_retreived_from) 有單詞出處的列表：

row1:sheet1
row2:sheet2
row3:sheet3
row4:sheet2

還有一個 words_collection ，它通過以下代碼包含單詞列表：

words_collection=[]
for w in sample.tokenised_text:
   for t in w:
       words_collection.append(t)

和工作表名稱來自： sheetlist=list(set(sample.sheet.to_list()))

但是，是否正在努力尋找一種正確的方法來遍歷數據幀以檢查一個單詞是否存在於多個工作表中？

基本上我正在尋找顯示的輸出：

Answer 1

import pandas as pd
import numpy as np


df = pd.DataFrame({'sheet':['sheet1', 'sheet2', 'sheet3', 'sheet2'],
    'tokenized_text':[['efcc', 'fficial', 'billiontwits', 'since', 'covid', 'landed'], ['when', 'people', 'say', 'the', 'fatality', 'rate', 'of', 'coronavirus', 'is'], ['in', 'the', 'coronavirus-induced', 'crisis', 'people', 'are',  'cyvbwx'], ['in', 'the', 'be-induced', 'crisis', 'people', 'are',  'cyvbwx']] })

words_collection = ['efcc','fficial','billiontwits','since','covid','landed','in']

# Create a dictionary that maps each sheet to the words it contains
sheets_words = {}

# Go over the rows of the dataframe, and concatenate for each sheet the words in it
for index, row in df.iterrows():
    sheet_id = row['sheet']
    if sheet_id not in sheets_words.keys():
        sheets_words[sheet_id] = set()
    sheets_words[sheet_id] |= set(row['tokenized_text'])

# Create a dictionary that maps for each word from `words_collection` the number of sheets it appears at
word_to_number_of_sheets = { w : 0 for w in words_collection }

# Go over the sheets
for sheet_id, sheet_words in sheets_words.items():
    # For each word in words_collection
    for w in words_collection:
        # Add 1 to the sheet it appears in if it appears in current sheet
        if w in sheet_words:
            word_to_number_of_sheets[w] += 1

word_to_number_of_sheets_as_list = [(k,v) for k,v in word_to_number_of_sheets.items()]

# [('efcc', 1), ('fficial', 1), ('billiontwits', 1), ('since', 1), ('covid', 1), ('landed', 1), ('in', 2)]
print(word_to_number_of_sheets_as_list)