More Effective Distributed ML via a Stale Synchronous Parallel Parameter Server
More Effective Distributed ML via a Stale Synchronous Parallel Parameter Server
Qirong Ho,James Cipar,6 Authors,E. Xing
2013 · DBLP: conf/nips/HoCCLKGGGX13
Neural Information Processing Systems · 796 Citations
TLDR
A parameter server system for distributed ML, which follows a Stale Synchronous Parallel (SSP) model of computation that maximizes the time computational workers spend doing useful work on ML algorithms, while still providing correctness guarantees.