# Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation Preprint · Zhenyu Liu, Yunzhen Liu, Zehao Fan, Garrett Gagnon, Yayue Hou, Nan Wu, Yangwook Kang, Liu Liu - Archive id: arxiv:2512.17073 - Published: 2025-12-18 - arXiv: https://arxiv.org/abs/2512.17073 - Source URL: https://arxiv.org/abs/2512.17073 - PDF: https://arxiv.org/pdf/2512.17073 - Provenance: arxiv ## Abstract Mixture-of-Experts (MoE) models scale capacity via sparse activation but stress memory and bandwidth. Offloading alleviates GPU memory by fetching experts on demand, yet token-level routing causes irregular transfers that make inference I/O-bound. Static uniform quantization reduces traffic but degrades accuracy under aggressive compression by ignoring expert heterogeneity. We present Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation, which performs router-guided precision restoration using precomputed low-rank compensators. At inference time, our method transfers compact low-rank factors with Top-n (n\