{"id":"arxiv:2608.10928","kind":"preprint","title":"ThinkRetrieve: Retrieval-Augmented Reasoning Traces for Test-Time Scaling","authors":["Vaibhav Singh","Soumya Suvra Ghosal","Sarvesh Gharat","Soumyabrata Pal","Ramasuri Narayanam","Dinesh Manocha"],"author_count":6,"year":2026,"published":"2026-08-11","venue":null,"cited_by":0,"doi":null,"arxiv_id":"2608.10928","nct_id":null,"source_url":"https://arxiv.org/abs/2608.10928","archive_url":"https://space-kitty.com/papers/arxiv:2608.10928","updated":"2026-08-11","pmid":null,"pmcid":null,"openalex_id":"W7202261961","pdf_url":"https://arxiv.org/pdf/2608.10928","abstract":"Large Reasoning Models (LRMs) improve performance by allocating additional inference-time compute to generate extended chain-of-thought reasoning. However, recent studies reveal that sequential test-time scaling often yields diminishing or even negative returns, as longer traces exhibit increased uncertainty, error compounding, and drift from the original problem. We propose ThinkRetrieve, a test-time scaling framework that augments the reasoning traces of LRMs with dynamically retrieved solved examples at each reasoning step. Given an external corpus of problems paired with step-by-step solutions, ThinkRetrieve retrieves relevant exemplars at each intermediate step and injects them directly into the thinking trace, providing the model with guidance on how to reason rather than merely what facts are relevant. Experiments across five reasoning models (1.5B--8B parameters) on GSM-8K, MATH-500, AIME 2025, and SciQ demonstrate that ThinkRetrieve consistently improves accuracy over standard test-time scaling, with relative gains of up to $60\\%$ on AIME 2025.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.AI"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"reasoning-models","name":"Reasoning Models & Test-Time Compute","domain_slug":"ai"}],"cited_in_dossiers":[]}