EventsThe 1st International Online Conference on Sensor and Actuator Networks
Published
This submission belongs to the session S5. Big Data, Computing and Artificial Intelligence of the event The 1st International Online Conference on Sensor and Actuator Networks
Published date
06 Jul, 2026
Academic Editor
author-avatarJianwei Niu
Citation
Anastasia Bougea, Multimodal Explainable Artificial Intelligence (XAI) Applied to Parkinson’s and Alzheimer’s Diseases, in Proceedings of The 1st International Online Conference on Sensor and Actuator Networks, 9 July–10 July 2026, MDPI: Basel, Switzerland
Share
Email
Facebook
Twitter
LinkedIn

Multimodal Explainable Artificial Intelligence (XAI) Applied to Parkinson’s and Alzheimer’s Diseases

image
1. 1st Department of Neurology, Medical School, NKUA, Athens, Greece, Greece
2. Translational Engineering in Health and Medicine, School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece.
Abstract

Neurodegenerative disorders, specifically Parkinson’s (PD) and Alzheimer’s disease (AD), present significant diagnostic challenges due to their heterogeneous symptomatology and overlapping clinical features. While deep learning has demonstrated remarkable potential in automated diagnosis, the "black box" nature of these models hinders their integration into clinical workflows, where interpretability is paramount.
This presentation introduces a comprehensive framework for Multimodal Explainable Artificial Intelligence (XAI) tailored to the early detection and progression monitoring of PD and AD. We utilize a [hybrid CNN-Transformer] architecture with a [late fusion] strategy to integrate diverse data modalities. By fusing neuroimaging [(MRI/PET)] and non-invasive biomarkers [(voice or gait analysis)], the proposed approach captures the multifaceted pathology of these diseases more effectively than unimodal systems. The model was evaluated on subsets of the public [ADNI and PPMI] cohorts, comprising approximately [1,200] subjects with paired multi-omic data.
Crucially, the framework integrates XAI techniques, including SHAP (SHapley Additive exPlanations) and attention mapping, to elucidate the algorithmic decision-making process. The clinical validity of these explainability outputs was strictly assessed through [expert neuroradiologist review and localization agreement] with established anatomical biomarkers. This allows clinicians to confidently visualize specific anatomical regions or signal features driving the model’s predictions. Empirical results demonstrate that our multimodal fusion achieves an AUC of [0.94] and an accuracy of [91%], outperforming standard unimodal baselines by [8-10%]. Ultimately, this work bridges the gap between high-performance AI and clinical trust, paving the way for reliable, personalized computer-aided diagnostic tools in neurology.

Keywords
Multimodal Fusion
Explainable AI
Parkinson’s Disease
Alzheimer’s Disease
Deep Learning
Clinical Decision Support
ForestWatch: Observing, Responding and Predicting the Deforestation Events using Wireless Sensors
Advancing AI and Robotics: Innovations in AgTech, Intelligent Transportation, and Assistive Technologies