{"id":"arxiv:2606.30951","kind":"article","title":"Learning Where to Look: A Reinforcement Learning Framework for Robust Micro-Ultrasound Prostate Cancer Detection","authors":["Mohammad Mahdi Abootorabi","Sina Namazi","Armin Saadat","Lyuyang Wang","Obed Dzikunu","Paul F. R. Wilson","Zhuoxin Guo","Brian Wodlinger","Parvin Mousavi","Purang Abolmaesumi"],"author_count":10,"year":2026,"published":"2026-06-29","venue":"Lecture notes in computer science","cited_by":0,"doi":"10.1007/978-3-032-38091-3_37","arxiv_id":"2606.30951","nct_id":null,"source_url":"https://arxiv.org/abs/2606.30951","archive_url":"https://space-kitty.com/papers/arxiv:2606.30951","updated":"2026-06-29","pmid":null,"pmcid":null,"openalex_id":"W7166832826","pdf_url":"https://arxiv.org/pdf/2606.30951","abstract":"Micro-ultrasound ($μ$US) is a new, emerging, and promising imaging modality for prostate cancer (PCa) detection, but accurate identification of suspicious tissue remains highly dependent on clinical experience, leading to substantial inter-observer variability. Machine-learning assistance can reduce this variability; however, training reliable deep models is challenging because supervision is sparse and noisy -- typically limited to core-level histopathology outcomes (e.g., cancer grade and its percentage in a biopsy core) without pixel-level lesion annotations and under severe class imbalance. We introduce Prost-RL, which reframes $μ$US PCa detection as a spatially aware, policy-driven inference problem by learning where to look before decoding. Prost-RL integrates a lightweight reinforcement-learning policy into a foundation-model encoder-decoder to generate interpretable spatial attention maps that act as soft prompts for both cancer-likelihood heatmap prediction and image-level classification. We further propose Adaptive Policy Optimization (APO) to stabilize hybrid supervised-RL training and a noise-robust objective combining symmetric cross-entropy with negative-entropy regularization to mitigate weak-label noise and encourage sharp localization. On a cohort of 6,607 biopsy cores from 693 patients across five clinical sites, Prost-RL achieves $79.0\\pm3.5$ AUROC with $64.6\\pm6.3$% sensitivity at 80% specificity for core-level detection (+2.1 AUROC and +4.5 sensitivity points over the strongest baseline), and $79.3\\pm5.8$ AUROC for clinically significant cancer classification. The learned policy highlights biopsy-aligned regions, providing transparent, spatially grounded evidence alongside quantitative risk predictions. Code is available at: https://github.com/DeepRCL/Prost-RL.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":null,"categories":["cs.CV","cs.AI","cs.LG"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"neuroai","name":"NeuroAI & Computational Neuroscience","domain_slug":"neuroscience"}],"cited_in_dossiers":[]}