# Towards Interpretable Radiology Report Generation via Concept Bottlenecks using a Multi-Agentic RAG

Article · Hasan Md Tusfiqur Alam, Devansh Srivastav, Md Abdul Kadir, Daniel Sonntag

- Archive id: arxiv:2412.16086
- Published: 2024-12-20
- Venue: Lecture Notes in Computer Science (LNCS) 2025, Volume 15574
- DOI: https://doi.org/10.1007/978-3-031-88714-7_18
- arXiv: https://arxiv.org/abs/2412.16086
- Citations: 16
- Source URL: https://arxiv.org/abs/2412.16086
- PDF: https://arxiv.org/pdf/2412.16086
- Provenance: arxiv

## Abstract

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a multi-agent Retrieval-Augmented Generation (RAG) system for report generation. By modeling relationships between visual features and clinical concepts, we create interpretable concept vectors that guide a multi-agent RAG system to generate radiology reports, enhancing clinical relevance, explainability, and transparency. Evaluation of the generated reports using an LLM-as-a-judge confirmed the interpretability and clinical utility of our model's outputs. On the COVID-QU dataset, our model achieved 81% classification accuracy and demonstrated robust report generation performance, with five key metrics ranging between 84% and 90%. This interpretable multi-agent framework bridges the gap between high-performance AI and the explainability required for reliable AI-driven CXR analysis in clinical settings. Our code is available at https://github.com/tifat58/IRR-with-CBM-RAG.git.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [AI in Clinical Medicine](https://space-kitty.com/topics/ai-medicine)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.