{"id":"arxiv:2505.24133","kind":"preprint","title":"R-KV: Redundancy-aware KV Cache Compression for Reasoning Models","authors":["Zefan Cai","Wen Xiao","Hanshi Sun","Cheng Luo","Yikai Zhang","Ke Wan","Yucheng Li","Yeyang Zhou","Li-Wen Chang","Jiuxiang Gu","Zhen Dong","Anima Anandkumar","Abedelkadir Asi","Junjie Hu"],"author_count":14,"year":2025,"published":"2025-05-30","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2505.24133","nct_id":null,"source_url":"https://arxiv.org/abs/2505.24133","archive_url":"https://space-kitty.com/papers/arxiv:2505.24133","updated":"2026-01-22","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2505.24133","abstract":"Reasoning models have demonstrated impressive performance in self-reflection and chain-of-thought reasoning. However, they often produce excessively long outputs, leading to prohibitively large key-value (KV) caches during inference. While chain-of-thought inference significantly improves performance on complex reasoning tasks, it can also lead to reasoning failures when deployed with existing KV cache compression approaches. To address this, we propose Redundancy-aware KV Cache Compression for Reasoning models (R-KV), a novel method specifically targeting redundant tokens in reasoning models. Our method preserves nearly 100% of the full KV cache performance using only 10% of the KV cache, substantially outperforming existing KV cache baselines, which reach only 60% of the performance. Remarkably, R-KV even achieves 105% of full KV cache performance with 16% of the KV cache. This KV-cache reduction also leads to a 90% memory saving and a 6.6X throughput over standard chain-of-thought reasoning inference. Experimental results show that R-KV consistently outperforms existing KV cache compression baselines across two mathematical reasoning datasets.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.CL","cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}