UPDF AI

INFaaS: Automated Model-less Inference Serving

Francisco Romero,Qian Li,N. Yadwadkar,Christos Kozyrakis

2021 · DBLP: conf/usenix/Romero0YK21
USENIX Annual Technical Conference · 237 citations

TLDR

A lack of understanding of the trade-off space of model-variants can incur costs to developers because of the diversity across variants and hardware platforms in the cloud.