如何將 BatchNormalization 應用於 Keras LSTM 的輸入？

Question

我有：

    model = Sequential()
    model.add(LSTM(32, input_shape=(
        SEQ_LENGTH, VECTOR_SIZE), return_sequences=True))
    model.add(TimeDistributed(Dense(VECTOR_SIZE, activation='relu')))

    adam_optimizer = optimizers.Adam(
        learning_rate=0.001, beta_1=0.9, beta_2=0.999, amsgrad=False)
    model.compile(loss='mean_squared_error',
                  optimizer=adam_optimizer)

我的模型的輸入和輸出都是(100, 129) 。

Answer 1

model.add(BatchNormalization(center=True, scale=True, beta_regularizer=regularizers.l2(0.01),
                                 gamma_regularizer=regularizers.l2(0.01),
                                 beta_constraint='max_norm', gamma_constraint='max_norm',
                                 input_shape=(x, y)))

它只是您添加到模型中的一個層