[英]Resampling a pandas MultiIndex dataframe
我有一個類似於以下的pandas MultiIndex數據幀:
import pandas as pd
rows = [('One', 'One', 'One', '20120105', 1, 'Text1'),
('One', 'One', 'One', '20120107', 2, 'Text2'),
('One', 'One', 'One', '20120110', 3, 'Text3'),
('One', 'One', 'Two', '20120104', 4, 'Text4'),
('One', 'Two', 'One', '20120109', 5, 'Text5'),
('Two', 'Three', 'Four', '20120111', 6, 'Text6')]
cols = ['Type', 'Subtype', 'Subsubtype', 'Date', 'Number', 'Text']
df = pd.DataFrame.from_records(rows, columns=cols)
df['Date'] = pd.to_datetime(df['Date'])
df = df.set_index(['Type', 'Subtype', 'Subsubtype'])
end_date = max(df['Date'])
print(df)
Date Number Text
Type Subtype Subsubtype
One One One 2012-01-05 1 Text1
One 2012-01-07 2 Text2
One 2012-01-10 3 Text3
Two 2012-01-04 4 Text4
Two One 2012-01-09 5 Text5
Two Three Four 2012-01-11 6 Text6
我想對數據進行上采樣,以便Type-Subtype-Subsubtype索引的每個組合獲得每日日期數據:從可用數據的最小日期到end_date = max(df ['Date'])。
我想要的一個例子:
Date Number Text
Type Subtype Subsubtype
One One One 2012-01-05 1 Text1
One 2012-01-06 1 Text2
One 2012-01-07 2 Text2
One 2012-01-08 2 Text2
One 2012-01-09 2 Text2
One 2012-01-10 3 Text3
One 2012-01-11 3 Text3
Two 2012-01-04 4 Text4
Two 2012-01-05 4 Text4
Two 2012-01-06 4 Text4
Two 2012-01-07 4 Text4
Two 2012-01-08 4 Text4
Two 2012-01-09 4 Text4
Two 2012-01-10 4 Text4
Two 2012-01-11 4 Text4
Two One 2012-01-09 5 Text5
One 2012-01-10 5 Text5
One 2012-01-11 5 Text5
Two Three Four 2012-01-11 6 Text6
通過類似的問題,我找不到任何可以工作的東西。 任何幫助是極大的贊賞。
您可以使用:
groupby
的所有級別的Multiindex
apply
date_range
apply
reindex
date_range
iat
以選擇第一個值 ffill
替換NaN
df = df.groupby(level=[0,1,2]) \
.apply(lambda x: x.set_index('Date').reindex(pd.date_range(x['Date'].iat[0],
end_date))).ffill()
print (df)
Number Text
Type Subtype Subsubtype
One One One 2012-01-05 1.0 Text1
2012-01-06 1.0 Text1
2012-01-07 2.0 Text2
2012-01-08 2.0 Text2
2012-01-09 2.0 Text2
2012-01-10 3.0 Text3
2012-01-11 3.0 Text3
Two 2012-01-04 4.0 Text4
2012-01-05 4.0 Text4
2012-01-06 4.0 Text4
2012-01-07 4.0 Text4
2012-01-08 4.0 Text4
2012-01-09 4.0 Text4
2012-01-10 4.0 Text4
2012-01-11 4.0 Text4
Two One 2012-01-09 5.0 Text5
2012-01-10 5.0 Text5
2012-01-11 5.0 Text5
Two Three Four 2012-01-11 6.0 Text6
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.