是否可以合并 python 中具有相似名称（列）的 csv 个文件？

Question

I have 3 CSV files that i want to merge. First one having the column header being movies_title, release_date, genre Second one having show_id, type, title Third one having title, rating,ratingLevel.

Is there a way to merge so it will be like title, release_date,genre, show_id, type, rating, ratingLevel?

Answer 1

Assuming df1, df2 & df3 are three dataframes loaded in python;

Solution1:

First maybe you can rename title column for df1 & then merge all 3 like this;

df1.rename(columns={'movies_title':'title'}, inplace=True)

from functools import reduce
dfs = [df1, df2, df3]
df_final = reduce(lambda left,right: pd.merge(left,right,on='title'), dfs)

Solution2:

If you don't wish to rename any of your columns then this shall work;

df_final = df1.merge(df2,how="left",left_on="movies_title",right_on="title")
del df_final["movies_title"]
df_final = df_final.merge(df3,how="left",on="title")

Solution3 Not sure if this is the best way to get similar columns from 2 different data frames, but you can do fuzzy matching of all combination of columns of 2 dfs then do the merging;

col1 = ["movies_title", "release_date", "genre"] # df1.columns
col2 = ["show_id", "type", "title"] # df2.columns
from fuzzywuzzy import fuzz
lst_col,num = [], [] 
for i in col1: 
    for j in col2:
        lst_col.append([i,j])
        num.append(fuzz.ratio(i,j))    
best_match = lst_col[num.index(max(num))]

# Output of best_match:
# ['movies_title', 'title']

df_final = df1.merge(df2,how="left",left_on=best_match[0],right_on=best_match[1])