在 python 中使用 LSTM 添加滯后時的 NaN 值

Question

我正在嘗試根據數據集分析和預測銷售額，我已經整理了我的數據，但是，當我嘗試創建滯后時，每月銷售額滯后的值為 NaN，這個 NaN 是什么意思？ 從我指的教程中，他沒有這些 NaN 值，至少當他刪除 NaN 值時，他仍然有一些輸出，但在我的情況下，當我刪除 NaN 值時，我什么都沒有......

from __future__ import division
from datetime import datetime, timedelta, date
import pandas as pd
%matplotlib inline
import matplotlib.pyplot as plt
import numpy as np

import warnings
warnings.filterwarnings("ignore")

import plotly.plotly as py
import plotly.offline as pyoff
import plotly.graph_objs as go

import keras
from keras.layers import Dense
from keras.models import Sequential
from keras.optimizers import Adam 
from keras.callbacks import EarlyStopping
from keras.utils import np_utils
from keras.layers import LSTM
from sklearn.model_selection import KFold, cross_val_score, train_test_split

#initiate plotly
pyoff.init_notebook_mode()

#read data
df = pd.read_csv(r"C:\Users\User\Desktop\UOW\Yr3\FYP\Sample.csv", encoding='latin-1')

df['Order Date'] = pd.to_datetime(df['Order Date'])

df.head(10)

# Drop empty cells
df.dropna(axis=0, how='all', thresh=None, subset=None, inplace=False)
df.shape

# Drop unwanted columns
# Order ID, Ship Date, Ship Mode, Segment, Country, City, State, Postal Code, Region, Product ID, 
Category, Sub-Category, Product Name,

# Discount
df_sales = df.drop(['Order ID', 'Segment', 'Country', 'City', 'State', 'Postal Code', 'Region', 'Product ID', 'Category', 'Sub-Category', 'Product Name','Discount'], axis = 1)
df_sales.head(10)

# represent month in date field as its first day
df_sales['Order Date'] = pd.to_datetime(df_sales['Order Date']).dt.strftime("%Y-%m-%d")
df_sales = df_sales.groupby('Order Date').Sales.sum().reset_index()
df_sales

#plot monthly sales
 plot_data = [
    go.Scatter(
        x=df_sales['Order Date'],
        y=df_sales['Sales'],
    )
]
plot_layout = go.Layout(
         title='Montly Sales'
    )
fig = go.Figure(data=plot_data, layout=plot_layout)
pyoff.iplot(fig)

# Create a new dataframe to model the difference
df_diff = df_sales.copy()

# Add previous sales to the next row
df_diff['Prev_Sales'] = df_diff['Sales'].shift(1)

# Drop the null values and calculate the difference
df_diff = df_diff.dropna()
df_diff['diff'] = (df_diff['Sales'] - df_diff['Prev_Sales'])

df_diff.head(10)

#plot sales diff
plot_data = [
    go.Scatter(
        x=df_diff['Order Date'],
        y=df_diff['diff'],)]

plot_layout = go.Layout(
        title='Montly Sales Difference')

fig = go.Figure(data=plot_data, layout=plot_layout)
pyoff.iplot(fig)

#create dataframe for transformation from time series to supervised
df_supervised = df_diff.drop(['Prev_Sales'],axis=1)

#adding lags
for inc in range(1,13):
    field_name = 'lag_' + str(inc)
    df_supervised[field_name] = df_supervised['diff'].shift(inc)

#drop null values
#df_supervised = df_supervised.dropna().reset_index(drop=True)***

df_supervised

然后我得到的輸出是

訂購日期 | 銷售 | 差異| 滯后_1 | 滯后_2 | 滯后_3 | 滯后_4 | 滯后_5 | 滯后_6 | 滯后_7 | 滯后_8 | 滯后_9 | 滯后_10 | 滯后_11 | 滯后_12

1 2019-02-01 | 333904.9556 | -30136.6174 | 南| 南| 南| 南| 南| 南| 南| 南| 南| 南| 南| NaN

2 2019-03-01 | 361431.8218 | 27526.8662 | -30136.6174 | 南| 南| 南| 南| 南| 南| 南| 南| 南| 南| NaN

3 2019-04-01 | 359930.1225 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| 南| 南| 南| 南| 南| 南| 南| NaN

4 2019-05-01 | 348999.4696 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| 南| 南| 南| 南| 南| 南| NaN

5 2019-06-01 | 372904.5441 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| 南| 南| 南| 南| 南| NaN

6 2019-07-01 | 372936.2013 | 31.6572 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| 南| 南| 南| 南| NaN

7 2019-08-01 | 328648.3505 | -44287.8508 | 31.6572 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| 南| 南| 南| NaN

8 2019-09-01 | 371825.2898 | 43176.9393 | -44287.8508 | 31.6572 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| 南| NaN

9 2019-10-01 | 363781.0459 | -8044.2439 | 43176.9393 | -44287.8508 | 31.6572 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | NaN
| 南| 南| NaN

10 2019-11-01 | 336836.8240 | -26944.2219 | -8044.2439 | 43176.9393 | -44287.8508 | 31.6572 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| 南| NaN

11 2019-12-01 | 374106.0722 | 37269.2482 | -26944.2219 | -8044.2439 | 43176.9393 | -44287.8508 | 31.6572 | 23905.0745 | -10930.6529 | -1501.6993 | 27526.8662 | -30136.6174 | 南| NaN

如果我取消注釋此代碼： df_supervised = df_supervised.dropna().reset_index(drop=True)它只會顯示標題的輸出

訂購日期 | 銷售 | 差異| 滯后_1 | 滯后_2 | 滯后_3 | 滯后_4 | 滯后_5 | 滯后_6 | 滯后_7 | 滯后_8 | 滯后_9 | 滯后_10 | 滯后_11 | 滯后_12

任何人都可以幫我解決這個問題嗎？ 非常感謝！

Answer 1

NaN 是指非數字。

使用滯后時間時通常有一個 NaN。

如果您想保留您的數據，您應該嘗試填充 NaN 而不是刪除它們。

例如df.fillna(0)

你可以先看看這里： https : //pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.fillna.html