# Regional Attention-Enhanced Swin Transformer for Clinically Relevant Medical Image Captioning

Article · Zubia Naz, Farhan Asghar, Muhammad Ishfaq Hussain, Yahya Hadadi, Muhammad Aasim Rafique, Wookjin Choi, Moongu Jeon

- Archive id: arxiv:2511.09893
- Published: 2025-11-13
- Venue: 2026 IEEE 5th International Conference on Computing and Machine Intelligence (ICMI), 2026
- DOI: https://doi.org/10.1109/icmi68585.2026.11539781
- arXiv: https://arxiv.org/abs/2511.09893
- Citations: 0
- Source URL: https://arxiv.org/abs/2511.09893
- PDF: https://arxiv.org/pdf/2511.09893
- Provenance: arxiv

## Abstract

Automated medical image captioning translates complex radiological images into diagnostic narratives that can support reporting workflows. We present a Swin-BART encoder-decoder system with a lightweight regional attention module that amplifies diagnostically salient regions before cross-attention. Trained and evaluated on ROCO, our model achieves state-of-the-art semantic fidelity while remaining compact and interpretable. We report results as mean$\\pm$std over three seeds and include $95\\%$ confidence intervals. Compared with baselines, our approach improves ROUGE (proposed 0.603, ResNet-CNN 0.356, BLIP2-OPT 0.255) and BERTScore (proposed 0.807, BLIP2-OPT 0.645, ResNet-CNN 0.623), with competitive BLEU, CIDEr, and METEOR. We further provide ablations (regional attention on/off and token-count sweep), per-modality analysis (CT/MRI/X-ray), paired significance tests, and qualitative heatmaps that visualize the regions driving each description. Decoding uses beam search (beam size $=4$), length penalty $=1.1$, $no\\\_repeat\\\_ngram\\\_size$ $=3$, and max length $=128$. The proposed design yields accurate, clinically phrased captions and transparent regional attributions, supporting safe research use with a human in the loop.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [AI in Clinical Medicine](https://space-kitty.com/topics/ai-medicine)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.