{"id":"arxiv:2610.29527","kind":"preprint","title":"RCSD: Reinforcement and Continual Learning for Domain-Specific Speculative Decoding","authors":["Mingkang Liu","Weiming Meng","Peipei Jiao","Jiawei Zhang","Tianyuan Liu","Junyan Li","Lichen Pang"],"author_count":7,"year":2026,"published":"2026-10-21","venue":null,"cited_by":null,"doi":null,"arxiv_id":"2610.29527","nct_id":null,"source_url":"https://arxiv.org/abs/2610.29527","archive_url":"https://space-kitty.com/papers/arxiv:2610.29527","updated":"2026-10-21","pmid":null,"pmcid":null,"openalex_id":null,"pdf_url":"https://arxiv.org/pdf/2610.29527","abstract":"Speculative decoding accelerates large language model inference by employing a compact draft model to propose candidate tokens that are verified in parallel by a target model. Conventional training relies on soft-label distillation, which forces the draft model to mimic the target's full output distribution, including high-entropy regions that degrade acceptance rates and increase early rejection risk. We propose RCSD (Reinforcement and Continual Learning for Speculative Decoding), a training framework that aligns draft model optimization with the system-level objective of maximizing acceptance length. RCSD leverages naturally occurring accepted and rejected sequences during speculative inference to construct implicit preference pairs, with masked loss to avoid penalizing target-aligned tokens. Evaluated across multiple benchmarks, RCSD improves average acceptance length by 35% over HASS and achieves 1.35x faster end-to-end inference than HASS on practical workloads, without compromising generation quality.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":false,"categories":["cs.CL"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[],"cited_in_dossiers":[]}