{"id":"arxiv:2412.16086","kind":"article","title":"Towards Interpretable Radiology Report Generation via Concept Bottlenecks using a Multi-Agentic RAG","authors":["Hasan Md Tusfiqur Alam","Devansh Srivastav","Md Abdul Kadir","Daniel Sonntag"],"author_count":4,"year":2024,"published":"2024-12-20","venue":"Lecture Notes in Computer Science (LNCS) 2025, Volume 15574","cited_by":16,"doi":"10.1007/978-3-031-88714-7_18","arxiv_id":"2412.16086","nct_id":null,"source_url":"https://arxiv.org/abs/2412.16086","archive_url":"https://space-kitty.com/papers/arxiv:2412.16086","updated":"2025-01-22","pmid":null,"pmcid":null,"openalex_id":"W4409183282","pdf_url":"https://arxiv.org/pdf/2412.16086","abstract":"Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a multi-agent Retrieval-Augmented Generation (RAG) system for report generation. By modeling relationships between visual features and clinical concepts, we create interpretable concept vectors that guide a multi-agent RAG system to generate radiology reports, enhancing clinical relevance, explainability, and transparency. Evaluation of the generated reports using an LLM-as-a-judge confirmed the interpretability and clinical utility of our model's outputs. On the COVID-QU dataset, our model achieved 81% classification accuracy and demonstrated robust report generation performance, with five key metrics ranging between 84% and 90%. This interpretable multi-agent framework bridges the gap between high-performance AI and the explainability required for reliable AI-driven CXR analysis in clinical settings. Our code is available at https://github.com/tifat58/IRR-with-CBM-RAG.git.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":null,"categories":["cs.IR","cs.AI","cs.CL","cs.CV","eess.IV"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"ai-medicine","name":"AI in Clinical Medicine","domain_slug":"medicine"}],"cited_in_dossiers":[]}