Training Deeper Models by GPU Memory Optimization on TensorFlow
Training Deeper Models by GPU Memory Optimization on TensorFlow
Chen Meng,Minmin Sun,2 Authors,Yang Gu
2017
85 Citations
TLDR
A general dataflow-graph based GPU memory optimization strategy, i.e.,“swap-out/in”, to utilize host memory as a bigger memory pool to overcome the limitation of GPU memory.