繁体   English   中英

为什么重复训练后NN不能得到某一个output?

[英]Why NN can not get one certain output after repeating train?

先上代码:

import numpy as np
np.random.seed(1231)

from keras import backend as K
import pickle
from keras.models import Sequential
from keras.layers import Dense, Dropout, Activation, Flatten
from keras.layers import Conv1D, MaxPooling1D
from keras.utils import np_utils
from sklearn.model_selection import train_test_split
from keras import initializers

data=pickle.load(open('DATA.pkl','rb'),encoding='latin1')

X=np.array(data[0])
Y=np.array(data[1])

X-=np.min(X)
X/=np.max(X)

X_train, X_test, Y_train, Y_test =train_test_split(X,Y,test_size=0.25, random_state=456)

X_train = X_train.reshape(X_train.shape[0],1000,1)
X_test = X_test.reshape(X_test.shape[0],1000,1)

model = Sequential()
model.add(Flatten(input_shape=(1000,1)))
gu=initializers.glorot_uniform(seed=789)
model.add(Dense(1, activation='sigmoid',kernel_initializer=gu))

model.compile(loss='binary_crossentropy',optimizer='adam', metrics=['accuracy'])

model.fit(X_train, Y_train,batch_size=1, epochs=1, verbose=2,shuffle=False)

score = model.evaluate(X_test, Y_test, verbose=0)

print(score)
print(model.get_layer(index=2).get_weights())

然后是output,有时是这样的:

Epoch 1/1
 - 1s - loss: 0.8007 - acc: 0.4720
[0.70776916790008548, 0.53200000023841854]
[array([[  2.89239828e-03],
       [ -1.48389703e-02],
       [  7.60693178e-02],
       ...
       [  2.92943567e-02],
       [  1.84460226e-02],
       [  2.38316301e-02]], dtype=float32), array([-0.00218478], dtype=float32)]

但有时像这样:

Epoch 1/1
 - 1s - loss: 0.8008 - acc: 0.4720
[0.7077700834274292, 0.53200000023841854]
[array([[  2.89072399e-03],
       [ -1.48402918e-02],
       [  7.60683641e-02],
       ...
       [  2.92898733e-02],
       [  1.84418838e-02],
       [  2.38287449e-02]], dtype=float32), array([-0.00218458], dtype=float32)]

每次,即使在这个简单的网络中,输出也是不同的。

我分配了随机种子,但它们效果不佳。

那么,代码有什么问题?(我希望它具有完全可重现的输出)

尝试tf.random.set_seed()全局设置它,以防在您没有预料到的地方使用了其他一些随机性 - 例如,可能是优化器。

在版本 1 中,它是tf.set_random_seed()

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM