# Key, Value, Compress: A Systematic Exploration of KV Cache Compression Techniques

Preprint · Neusha Javidnia, Bita Darvish Rouhani, Farinaz Koushanfar

- Archive id: arxiv:2503.11816
- Published: 2025-03-14
- arXiv: https://arxiv.org/abs/2503.11816
- Source URL: https://arxiv.org/abs/2503.11816
- PDF: https://arxiv.org/pdf/2503.11816
- Provenance: arxiv

## Abstract

Large language models (LLMs) have demonstrated exceptional capabilities in generating text, images, and video content. However, as context length grows, the computational cost of attention increases quadratically with the number of tokens, presenting significant efficiency challenges. This paper presents an analysis of various Key-Value (KV) cache compression strategies, offering a comprehensive taxonomy that categorizes these methods by their underlying principles and implementation techniques. Furthermore, we evaluate their impact on performance and inference latency, providing critical insights into their effectiveness. Our findings highlight the trade-offs involved in KV cache compression and its influence on handling long-context scenarios, paving the way for more efficient LLM implementations.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.