A multilayer multimodal detection and prediction model based on explainable artificial intelligence for Alzheimer’s disease
Многоуровневая мультимодальная модель выявления и прогнозирования на основе объяснимого искусственного интеллекта для болезни Альцгеймера
2021-01-29
SCID: 54.1/sewg2vw4
Discuss with AI
Alzheimer’s diseaseSHAP feature attributionexplainable artificial intelligencemultimodal detectionrandom forest
Figures from the paper
Abstract (AI)
Alzheimer's disease (AD) is the most common type of dementia. Its diagnosis and progression detection have been intensively studied. Nevertheless, research studies often have little effect on clinical practice mainly due to the following reasons: (1) Most studies depend mainly on a single modality, especially neuroimaging; (2) diagnosis and progression detection are usually studied separately as two independent problems; and (3) current studies concentrate mainly on optimizing the performance of complex machine learning models, while disregarding their explainability. As a result, physicians struggle to interpret these models, and feel it is hard to trust them. In this paper, we carefully develop an accurate and interpretable AD diagnosis and progression detection model. This model provides physicians with accurate decisions along with a set of explanations for every decision. Specifically, the model integrates 11 modalities of 1048 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) real-world dataset: 294 cognitively normal, 254 stable mild cognitive impairment (MCI), 232 progressive MCI, and 268 AD. It is actually a two-layer model with random forest (RF) as classifier algorithm. In the first layer, the model carries out a multi-class classification for the early diagnosis of AD patients. In the second layer, the model applies binary classification to detect possible MCI-to-AD progression within three years from a baseline diagnosis. The performance of the model is optimized with key markers selected from a large set of biological and clinical measures. Regarding explainability, we provide, for each layer, global and instance-based explanations of the RF classifier by using the SHapley Additive exPlanations (SHAP) feature attribution framework. In addition, we implement 22 explainers based on decision trees and fuzzy rule-based systems to provide complementary justifications for every RF decision in each layer. Furthermore, these explanations are represented in natural language form to help physicians understand the predictions. The designed model achieves a cross-validation accuracy of 93.95% and an F1-score of 93.94% in the first layer, while it achieves a cross-validation accuracy of 87.08% and an F1-Score of 87.09% in the second layer. The resulting system is not only accurate, but also trustworthy, accountable, and medically applicable, thanks to the provided explanations which are broadly consistent with each other and with the AD medical literature. The proposed system can help to enhance the clinical understanding of AD diagnosis and progression processes by providing detailed insights into the effect of different modalities on the disease risk.
Key Findings
1
Random forest performance is optimized by selecting key markers from extensive biological and clinical measurements.
2
The first model layer performs multiclass classification among cognitively normal, stable MCI, progressive MCI, and Alzheimer’s disease groups.
3
The framework enhances interpretability through global and instance-level SHAP explanations and 22 complementary decision-tree and fuzzy-rule explainers for individual predictions.
4
The second layer performs binary prediction of possible MCI-to-AD progression within three years of baseline diagnosis.
5
The study develops a multilayer model integrating 11 data modalities from 1,048 ADNI subjects for Alzheimer’s diagnosis and progression prediction.
Research Object
Alzheimer’s disease diagnosis and progression in subjects from the ADNI real-world cohort, including cognitively normal individuals, stable MCI, progressive MCI, and AD patients
Research Subject
Accurate, multimodal, and interpretable detection of AD and prediction of MCI-to-AD progression within three years from baseline
Publication Details
Publication Date
2021-01-29
Journal
Publisher
ISSN
Cited by
361
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai4
Cited by3
Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence2023
Interpreting artificial intelligence models: a systematic review on the application of LIME and SHAP in Alzheimer’s disease detection2024
Recent Applications of Explainable AI (XAI): A Systematic Literature Review2024