Improving Oversubscribed GPU Memory Performance in the PyTorch Framework

This paper builds upon the UM implementation and creates and utilize a minimal overhead CUPTI dynamic profiler to trace unified memory page fault and memory transfer statistics in PyTorch applications and implements CUDA memory prefetch and advise API.