如何比较项目列表是否出现在python数据框的每一行中

Question

I have a data_file of size 88k rows with 76 columns.

I want to compare if a list: subset = [40,49] is present in how many rows

I am comparing one row at a time as shown below:

My Code:

counter=0
for row in data_file.itertuples():
    if all(np.isin(subset, row)):
        counter = counter+1
print('Total occurences of subset: ', subset, '= ', counter)
print('--------------------------')

Execution time: 6.6398055266834035

Is there a better way to compare all rows at a time and save some time. I need to check may subsets so the time complexity of my code is high.

Thanks,

Gopi

Answer 1

np.sum((data_file==subset[0]).any(axis=1) & (data_file==subset[1]).any(axis=1))