簡體   English   中英

如何比較python3中的兩個csv文件?

[英]How to compare two csv files in python3?

我想將file1.csv列A與file2.csv列B和file1.csv列B與file2.csv列c以及file1.csv列c與file2.csv列A進行比較

import pandas as pd
df = pd.read_csv('table.csv', delimiter=',')
list1 = [list(row) for row in df.values]
#print(list_of_rows)

df1 = pd.read_csv('output_csv_file.csv', delimiter=',')
list2 = [list(row) for row in df1.values]
#print(list_of_rows1,"********************8")

new_items = []
for item in list2:
   if not any(x[1] == item[1] for x in list1):
       if not any(x[2] != item[2] for x in list1):       
           new_items.append(item)

我添加的示例輸入文件和預期輸出文件請指導我

file1                                                       

col_A    clo_B                    clo_C          col_D            

12345    2020-09-08 09:10:20      10.100.90.89   15



file2                                                       

col_A               clo_B          clo_C                      col_D   col_E    col_F     

10.100.90.89        21301          2020-09-08 09:10:20         15      1       6

10.100.90.89        12345          2020-09-08 09:10:20         15      1       6

10.100.90.89        12345          2020-06-08 09:10:20         15      1       6

Output:

col_A               clo_B          clo_C                      col_D   col_E    col_F     

10.100.90.89        21301          2020-09-08 09:10:20         15      1       6

10.100.90.89        12345          2020-06-08 09:10:20         15      1       6

如果您有數據框:

list1 = [
    ['12345', '2020-09-08 09:10:20', '10.100.90.89', '15']
]

list2 = [
    ['10.100.90.89','21301','2020-09-08 09:10:20','15','1','6'],
    ['10.100.90.89','12345','2020-09-08 09:10:20','15','1','6'],
    ['10.100.90.89','12345','2020-06-08 09:10:20','15','1','6'],
]

df1 = pd.DataFrame(list1, columns=['col_A','col_B','col_C','col_D'])
df2 = pd.DataFrame(list2, columns=['col_A','col_B','col_C','col_D','col_E','col_F'])

print(df1)
print(df2)

   col_A                col_B         col_C col_D
0  12345  2020-09-08 09:10:20  10.100.90.89    15
          col_A  col_B                col_C col_D col_E col_F
0  10.100.90.89  21301  2020-09-08 09:10:20    15     1     6
1  10.100.90.89  12345  2020-09-08 09:10:20    15     1     6
2  10.100.90.89  12345  2020-06-08 09:10:20    15     1     6

然后:

tmp = pd.DataFrame(df1[['col_C', 'col_A', 'col_B', 'col_D']])
tmp.columns = ['col_A','col_B','col_C','col_D']

out = df2.merge(tmp, on=['col_A', 'col_B', 'col_C', 'col_D'], how='left', indicator=True)
out = out[out['_merge'] == 'left_only'].drop(columns='_merge')
print(out)

將刪除重復項:

          col_A  col_B                col_C col_D col_E col_F
0  10.100.90.89  21301  2020-09-08 09:10:20    15     1     6
2  10.100.90.89  12345  2020-06-08 09:10:20    15     1     6

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM