Tensorflow contrib 学习弃用警告

Question

当我在我的代码中使用以下行时

vocab_processor = learn.preprocessing.VocabularyProcessor（max_document_length，词汇=弓）

我收到论文警告。 我如何消除它们？

WARNING:tensorflow:From /usr/local/lib/python3.5/dist-packages/tensorflow/contrib/learn/python/learn/datasets/base.py:198: retry (from tensorflow.contrib.learn.python.learn.datasets.base) is deprecated and will be removed in a future version. Instructions for updating: Use the retry module or similar alternatives. WARNING:tensorflow:From /tmp/anyReader-376H566fJpAUSEt/anyReader-376qtSRQxT2gOiq.tmp:67: VocabularyProcessor.__init__ (from tensorflow.contrib.learn.python.learn.preprocessing.text) is deprecated and will be removed in a future version. Instructions for updating: Please use tensorflow/transform or tf.data. WARNING:tensorflow:From /usr/local/lib/python3.5/dist-packages/tensorflow/contrib/learn/python/learn/preprocessing/text.py:154: CategoricalVocabulary.__init__ (from tensorflow.contrib.learn.python.learn.preprocessing.categorical_vocabulary) is deprecated and will be removed in a future version. Instructions for updating: Please use tensorflow/transform or tf.data. WARNING:tensorflow:From /usr/local/lib/python3.5/dist-packages/tensorflow/contrib/learn/python/learn/preprocessing/text.py:170: tokenizer (from tensorflow.contrib.learn.python.learn.preprocessing.text) is deprecated and will be removed in a future version. Instructions for updating: Please use tensorflow/transform or tf.data.

Answer 1

没有100%替换功能。 但是，有一些暗示方法可能有助于替换 vocab_processor() 的功能

1.compute_and_apply_vocabulary()

# Need to install tensorflow_transform with tf 2.3 
import tensorflow_transform as tft
review_indices = tft.compute_and_apply_vocabulary(review_tokens, top_k=VOCAB_SIZE)

参考代码： https : //github.com/tensorflow/transform/blob/master/examples/sentiment_example.py

2.采用tensorflow.keras的预处理

from tensorflow.keras.preprocessing import text, sequence
x = tf.keraspreprocessing.sequence.pad_sequences(x, maxlen=max_document_length, padding='post', truncating='post')

参考： https : //github.com/dennybritz/cnn-text-classification-tf/issues/147

无论如何，想出一种方法来 100% 替换它并不容易。

Answer 2

所有这些警告都有更新说明。 按照说明：切换到 tf.data 进行预处理。