Pandas 数据帧 - 合并两个数据帧，但省略具有同一列的条目

Question

I'm trying to create a DataFrame out of two existing ones. I read the title of some articles in the web, first column is title and the ones after are timestamps

i want to concat both data frames but leave out the ones with the same title (column one)

I tried

df = pd.concat([df1,df2]).drop_duplicates().reset_index(drop=True)

but because the other columns may not be the exact same all the time, I need to leave out every data pack that has the same first column. how would I do this?

btw sorry for not knowing all the right terms for my problem

Answer 1

You should first remove the duplicate rows from df2 and then concat it with df1 :

df = pd.concat([df1, df2[~df2.title.isin(df1.title)]]).reset_index(drop=True)

Answer 2

This probably solves your problem:

import pandas as pd
import numpy as np
df=pd.DataFrame(np.arange(2*5).reshape(2,5))
df2=pd.DataFrame(np.arange(2*5).reshape(2,5))
df.columns=['blah1','blah2','blah3','blah4','blah']
df2.columns=['blah5','blah6','blah7','blah8','blah']

for i in range(len(df.columns)):
    for j in range(len(df2.columns)):
        if df.columns[i] == df2.columns[j]:
            df2 = df2.drop(df2.columns[j], axis = 1)
        else:
            continue

print(pd.concat([df, df2], axis =1))