# Beyond Pixel Agreement: Large Language Models as Clinical Guardrails for Reliable Medical Image Segmentation

Article · Jiaxi Sheng, Leyi Yu, Haoyue Li, Yifan Gao, Xin Gao

- Archive id: arxiv:2506.01841
- Published: 2025-06-02
- Venue: IEEE International Conference on Artificial Intelligence, Computer Science and Information Processing (AICSIP)
- DOI: https://doi.org/10.1109/aicsip65423.2025.11427241
- arXiv: https://arxiv.org/abs/2506.01841
- Citations: 1
- Source URL: https://arxiv.org/abs/2506.01841
- PDF: https://arxiv.org/pdf/2506.01841
- Provenance: arxiv

## Abstract

Evaluating AI-generated medical image segmentations for clinical acceptability poses a significant challenge, as traditional pixelagreement metrics often fail to capture true diagnostic utility. This paper introduces Hierarchical Clinical Reasoner (HCR), a novel framework that leverages Large Language Models (LLMs) as clinical guardrails for reliable, zero-shot quality assessment. HCR employs a structured, multistage prompting strategy that guides LLMs through a detailed reasoning process, encompassing knowledge recall, visual feature analysis, anatomical inference, and clinical synthesis, to evaluate segmentations. We evaluated HCR on a diverse dataset across six medical imaging tasks. Our results show that HCR, utilizing models like Gemini 2.5 Flash, achieved a classification accuracy of 78.12%, performing comparably to, and in instances exceeding, dedicated vision models such as ResNet50 (72.92% accuracy) that were specifically trained for this task. The HCR framework not only provides accurate quality classifications but also generates interpretable, step-by-step reasoning for its assessments. This work demonstrates the potential of LLMs, when appropriately guided, to serve as sophisticated evaluators, offering a pathway towards more trustworthy and clinically-aligned quality control for AI in medical imaging.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [AI in Clinical Medicine](https://space-kitty.com/topics/ai-medicine)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.