Where is tf.contrib.layers.recompute_grad in TensorFlow 2.0?
Question
Does TensorFlow 2.0 have any support for making a computation as "recompute during the gradient pass" to save memory? TensorFlow 1.x has tf.contrib.layers.recompute_grad , but contrib is gone in TF 2.0 and it doesn't look like anyone moved recompute_grad .
1 answers
solution1
0 2019-06-29 18:17:33
Ya, they didn't move it. This is a big error on Google's part. I won't move to Tensorflow 2 for this reason. Recomputing gradients and creating memory efficient graphs is EXTREMELY helpful, if not vital.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Migrate tf.contrib.layers.batch_norm to Tensorflow 2.0
Rewrite tf.contrib.layers.batch_norm in Tensorflow 2.0
TensorFlow - tf.layers vs tf.contrib.layers
Tensorflow: tf.contrib.layers.embed_sequence
tf.contrib.layers.fully_connected() in Tensorflow 2?
Tensorflow2.0: What is the replacement of `tf.contrib.layers.fully_connected`?
How to convert tf.contrib to Tensorflow 2.0
Tensorflow: Transforming manually build layers to tf.contrib.layers
Tensorflow 2.x - tf.contrib.layers.variance_scaling_initializer()
Tensorflow tf.layers, tf.contrib.layers not working with variable scope
Related Tags