Accelerating Deep Learning Workloads Through Efficient Multi-Model Execution

HiveMind, a system designed specifically to optimize multi-model deep learning workloads, is proposed, which can accelerate simple hyperparameter tuning and multi- model inference workloads by up to 10× on NVIDIA P100 and V100 GPUs compared to sequential model execution.