[英]Python Pandas self merge on previous data
I have a DataFrame that contains many years worth of data. 我有一个包含多年数据的DataFrame。 I want to make a couple columns containing the previous years' data from the same DataFrame.
我要创建几个包含同一DataFrame的前几年数据的列。 Here's an example:
这是一个例子:
df = pd.DataFrame({'id': [1,1,1,2,2,2,3,4,5,3,3,3,4],
'yr': [87,88,89,54,55,53,87,87,89,90,91,92,86],
'data': '1-87 1-88 1-89 2-54 2-55 2-53 3-87 4-87 5-89 3-90 3-91 3-92 4-86'.split()})
data id yr
0 1-87 1 87
1 1-88 1 88
2 1-89 1 89
3 2-54 2 54
4 2-55 2 55
5 2-53 2 53
6 3-87 3 87
7 4-87 4 87
8 5-89 5 89
9 3-90 3 90
10 3-91 3 91
11 3-92 3 92
12 4-86 4 86
I'd like to add on another column that shows the previous years' data for that id number. 我想在另一列上添加该ID号的前几年数据。 like this:
像这样:
data id yr last_year_data
0 1-87 1 87 NaN
1 1-88 1 88 1-87
2 1-89 1 89 1-88
3 2-54 2 54 2-53
4 2-55 2 55 2-54
5 2-53 2 53 NaN
6 3-87 3 87 NaN
7 4-87 4 87 4-86
8 5-89 5 89 NaN
9 3-90 3 90 NaN
10 3-91 3 91 3-90
11 3-92 3 92 3-91
12 4-86 4 86 NaN
I tried to do this with a merge but I got Nan's all the way down in the 2nd half of the merge. 我尝试通过合并来做到这一点,但在合并的第二部分中我一直把Nan压倒了。 Here's my code for that:
这是我的代码:
df['last_year'] = df['yr'].apply(lambda x: x-1 if x > 0 else None)
df_test = df.merge(df, how='left',indicator=False,left_on=['id','yr'],right_on=['id','last_year'])
I know there's a better way to do this, but I'm not sure what it is. 我知道有更好的方法可以做到这一点,但是我不确定这是什么。 can you help?
你能帮我吗?
You can using shift
您可以使用
shift
df['New']=df.sort_values(['id','yr']).groupby('id').data.shift()
df
Out[793]:
data id yr New
0 1-87 1 87 NaN
1 1-88 1 88 1-87
2 1-89 1 89 1-88
3 2-54 2 54 2-53
4 2-55 2 55 2-54
5 2-53 2 53 NaN
6 3-87 3 87 NaN
7 4-87 4 87 4-86
8 5-89 5 89 NaN
9 3-90 3 90 3-87
10 3-91 3 91 3-90
11 3-92 3 92 3-91
12 4-86 4 86 NaN
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.