# Buffer Overflow in Mixture of Experts

Preprint · Jamie Hayes, Ilia Shumailov, Itay Yona

- Archive id: arxiv:2402.05526
- Published: 2024-02-08
- arXiv: https://arxiv.org/abs/2402.05526
- Source URL: https://arxiv.org/abs/2402.05526
- PDF: https://arxiv.org/pdf/2402.05526
- Provenance: arxiv

## Abstract

Mixture of Experts (MoE) has become a key ingredient for scaling large foundation models while keeping inference costs steady. We show that expert routing strategies that have cross-batch dependencies are vulnerable to attacks. Malicious queries can be sent to a model and can affect a model's output on other benign queries if they are grouped in the same batch. We demonstrate this via a proof-of-concept attack in a toy experimental setting.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.