Nexus: Bringing Efficient and Scalable Training to Deep Learning Frameworks

Empirical evaluations with a diverse set of deep learning applications demonstrate that Nexus is easy to integrate and can deliver efficient distributed training services to major deep learning frameworks, and its optimization schemes are highly effective to shorten the training time with targeted accuracy bounds.