[英]Drop duplicates of one column based on value in another column, Python, Pandas
I have a dataframe like this: 我有一个这样的数据框:
Date PlumeO Distance
2014-08-13 13:48:00 754.447905 5.844577
2014-08-13 13:48:00 754.447905 6.888653
2014-08-13 13:48:00 754.447905 6.938860
2014-08-13 13:48:00 754.447905 6.977284
2014-08-13 13:48:00 754.447905 6.946430
2014-08-13 13:48:00 754.447905 6.345506
2014-08-13 13:48:00 754.447905 6.133567
2014-08-13 13:48:00 754.447905 5.846046
2014-08-13 16:59:00 754.447905 6.345506
2014-08-13 16:59:00 754.447905 6.694847
2014-08-13 16:59:00 754.447905 5.846046
2014-08-13 16:59:00 754.447905 6.977284
2014-08-13 16:59:00 754.447905 6.938860
2014-08-13 16:59:00 754.447905 5.844577
2014-08-13 16:59:00 754.447905 6.888653
2014-08-13 16:59:00 754.447905 6.133567
2014-08-13 16:59:00 754.447905 6.946430
I'm trying to keep the date with the smallest distance, so drop the duplicates dates and keep the with the smallest distance. 我试图将日期保持在最短的距离,因此请删除重复的日期,并将日期保持在最短的距离。
Is there a way to achieve this in pandas' df.drop_duplicates
or am I stuck using if statements to find the smallest distance? 有没有办法在熊猫的
df.drop_duplicates
实现此df.drop_duplicates
或者我是否坚持使用if语句查找最小距离?
Sort by distances and drop by dates: 按距离排序并按日期排序:
df.sort_values('Distance').drop_duplicates(subset='Date', keep='first')
Out:
Date PlumeO Distance
0 2014-08-13 13:48:00 754.447905 5.844577
13 2014-08-13 16:59:00 754.447905 5.844577
The advantage of these approaches is that it does not require a sort. 这些方法的优点是不需要排序。
Option 1 选项1
You can identify the index values for the minimum values with idxmin
and you can use it within a groupby
. 您可以使用
idxmin
标识最小值的索引值,并且可以在groupby
使用它。 Use these results to slice your dataframe. 使用这些结果来切片数据框。
df.loc[df.groupby('Date').Distance.idxmin()]
Date PlumeO Distance
0 2014-08-13 13:48:00 754.447905 5.844577
13 2014-08-13 16:59:00 754.447905 5.844577
Option 2 选项2
You can use pd.DataFrame.nsmallest
to return the rows associated with the smallest distance. 您可以使用
pd.DataFrame.nsmallest
返回与最小距离关联的行。
df.groupby('Date', group_keys=False).apply(
pd.DataFrame.nsmallest, n=1, columns='Distance'
)
Date PlumeO Distance
0 2014-08-13 13:48:00 754.447905 5.844577
13 2014-08-13 16:59:00 754.447905 5.844577
我会说先对数据排序,然后删除重复的日期:
stripped_data = df.sort_values('distance').drop_duplicates('date', keep='first')
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.