MIDAS: A Dynamic Cross-GPU KV Cache Offloading Framework for LLM on GPU Cluster Systems
MIDAS: A Dynamic Cross-GPU KV Cache Offloading Framework for LLM on GPU Cluster Systems
Zixia Zhang,Chaonong Xu,4 Authors,Chao Li
2026 · DOI: 10.1109/icassp55912.2026.11461518
IEEE International Conference on Acoustics, Speech, and Signal Processing · 0 Citations