簡體   English   中英

用系數重新采樣熊貓數據框

[英]Resample a Pandas dataframe with coefficients

我有一個包含以下列的數據框: {'day','measurement'}

一天可能有幾次測量(或完全沒有測量)

例如:

day     |    measurement
1       |     20.1
1       |     20.9
3       |     19.2
4       |     20.0
4       |     20.2

以及系數數組: coef={-1:0.2, 0:0.6, 1:0.2}

我的目標是對數據進行重新采樣並使用系數進行平均(應該省略缺失的數據)。

這是我寫來計算的代碼

window=[-1,0,-1]
df['resampled_measurement'][df['day']==d]=[coef[i]*df['measurement'][df['day']==d-i].mean() for i in window if df['measurement'][df['day']==d-i].shape[0]>0].sum()
df['resampled_measurement'][df['day']==d]/=[coef[i] for i in window if df['measurement'][df['day']==d-i].shape[0]>0].sum()

對於上面的示例,輸出應為:

Day  measurement
1    20.500
2    19.850
3    19.425
4    19.875

問題是代碼可以永遠運行,而且我很確定有更好的方法對系數進行重采樣。

任何建議將不勝感激!

以下是您要尋找的解決方案:

        # This is your data
In [2]: data = pd.DataFrame({
   ...:     'day': [1, 1, 3, 4, 4],
   ...:     'measurement': [20.1, 20.9, 19.2, 20.0, 20.2]
   ...: })

        # Pre-compute every day's average, filling the gaps
In [3]: measurement = data.groupby('day')['measurement'].mean()

In [4]: measurement = measurement.reindex(pd.np.arange(data.day.min(), data.day.max() + 1))

In [5]: coef = pd.Series({-1: 0.2, 0: 0.6, 1: 0.2})

        # Create a matrix with the time-shifted measurements
In [6]: matrix = pd.DataFrame({key: measurement.shift(key) for key, val in coef.iteritems()})

In [7]: matrix
Out[7]:
       -1     0     1
day
1     NaN  20.5   NaN
2    19.2   NaN  20.5
3    20.1  19.2   NaN
4     NaN  20.1  19.2

        # Take a weighted average of the matrix
In [8]: (matrix * coef).sum(axis=1) / (matrix.notnull() * coef).sum(axis=1)
Out[8]:
day
1    20.500
2    19.850
3    19.425
4    19.875
dtype: float64

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM