{"id":"arxiv:2502.10108","kind":"article","title":"NeuroXVocal: Detection and Explanation of Alzheimer's Disease through Non-invasive Analysis of Picture-prompted Speech","authors":["Nikolaos Ntampakis","Konstantinos Diamantaras","Ioanna Chouvarda","Magda Tsolaki","Vasileios Argyriou","Panagiotis Sarigianndis"],"author_count":6,"year":2025,"published":"2025-02-14","venue":"Medical Image Computing and Computer Assisted Intervention - MICCAI 2025. Lecture Notes in Computer Science, vol 15973. Springer, Cham (2025)","cited_by":3,"doi":"10.1007/978-3-032-05185-1_40","arxiv_id":"2502.10108","nct_id":null,"source_url":"https://arxiv.org/abs/2502.10108","archive_url":"https://space-kitty.com/papers/arxiv:2502.10108","updated":"2025-02-14","pmid":null,"pmcid":null,"openalex_id":"W4407632604","pdf_url":"https://arxiv.org/pdf/2502.10108","abstract":"The early diagnosis of Alzheimer's Disease (AD) through non invasive methods remains a significant healthcare challenge. We present NeuroXVocal, a novel dual-component system that not only classifies but also explains potential AD cases through speech analysis. The classification component (Neuro) processes three distinct data streams: acoustic features capturing speech patterns and voice characteristics, textual features extracted from speech transcriptions, and precomputed embeddings representing linguistic patterns. These streams are fused through a custom transformer-based architecture that enables robust cross-modal interactions. The explainability component (XVocal) implements a Retrieval-Augmented Generation (RAG) approach, leveraging Large Language Models combined with a domain-specific knowledge base of AD research literature. This architecture enables XVocal to retrieve relevant clinical studies and research findings to generate evidence-based context-sensitive explanations of the acoustic and linguistic markers identified in patient speech. Using the IS2021 ADReSSo Challenge benchmark dataset, our system achieved state-of-the-art performance with 95.77% accuracy in AD classification, significantly outperforming previous approaches. The explainability component was qualitatively evaluated using a structured questionnaire completed by medical professionals, validating its clinical relevance. NeuroXVocal's unique combination of high-accuracy classification and interpretable, literature-grounded explanations demonstrates its potential as a practical tool for supporting clinical AD diagnosis.","abstract_license":"CC0-1.0 (arXiv descriptive metadata)","license":null,"is_open_access":false,"retracted":false,"peer_reviewed":null,"categories":["cs.LG","q-bio.NC"],"details":null,"provenance":"arxiv","attribution":"Abstract: arXiv descriptive metadata (CC0). Thank you to arXiv for use of its open access interoperability. This service was not reviewed or approved by, nor does it necessarily express or reflect the policies or opinions of, arXiv.","topics":[{"slug":"neurodegeneration","name":"Alzheimer's, Parkinson's & Neurodegeneration","domain_slug":"medicine"}],"cited_in_dossiers":[]}