Deep Learning Workload Scheduling in GPU Datacenters: A Survey

This article surveys existing research efforts for both training and inference workloads and primarily presents how existing schedulers facilitate the respective workloads from the scheduling objectives and resource utilization manner.