Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence
Объяснимый искусственный интеллект (XAI): что нам известно и чего еще необходимо достичь для создания заслуживающего доверия искусственного интеллекта
2023-04-18
SCID: 54.1/wscuquh5
Discuss with AI
Explainable artificial intelligenceExplanation evaluation metricsPost-hoc explainabilityTrustworthy artificial intelligenceXAI datasets
Figures from the paper
Abstract (AI)
Artificial intelligence (AI) is currently being utilized in a wide range of sophisticated applications, but the outcomes of many AI models are challenging to comprehend and trust due to their black-box nature. Usually, it is essential to understand the reasoning behind an AI model’s decision-making. Thus, the need for eXplainable AI (XAI) methods for improving trust in AI models has arisen. XAI has become a popular research subject within the AI field in recent years. Existing survey papers have tackled the concepts of XAI, its general terms, and post-hoc explainability methods but there have not been any reviews that have looked at the assessment methods, available tools, XAI datasets, and other related aspects. Therefore, in this comprehensive study, we provide readers with an overview of the current research and trends in this rapidly emerging area with a case study example. The study starts by explaining the background of XAI, common definitions, and summarizing recently proposed techniques in XAI for supervised machine learning. The review divides XAI techniques into four axes using a hierarchical categorization system: (i) data explainability, (ii) model explainability, (iii) post-hoc explainability, and (iv) assessment of explanations. We also introduce available evaluation metrics as well as open-source packages and datasets with future research directions. Then, the significance of explainability in terms of legal demands, user viewpoints, and application orientation is outlined, termed as XAI concerns. This paper advocates for tailoring explanation content to specific user types. An examination of XAI techniques and evaluation was conducted by looking at 410 critical articles, published between January 2016 and October 2022, in reputed journals and using a wide range of research databases as a source of information. The article is aimed at XAI researchers who are interested in making their AI models more trustworthy, as well as towards researchers from other disciplines who are looking for effective XAI methods to complete tasks with confidence while communicating meaning from data.
Key Findings
1
It argues that explanations should be tailored to specific user types, considering legal requirements, user perspectives, and application contexts.
2
It organizes supervised-machine-learning XAI techniques into four hierarchical axes: data explainability, model explainability, post-hoc explainability, and explanation assessment.
3
The analysis examines 410 critical articles published between January 2016 and October 2022 to characterize XAI research and its role in trustworthy AI.
4
The review identifies a gap in prior XAI surveys by comprehensively covering assessment methods, tools, datasets, and related research aspects.
5
The study summarizes evaluation metrics, open-source XAI packages, datasets, current research trends, and proposed future research directions.
Research Object
Explainable Artificial Intelligence (XAI) methods and their ecosystem (techniques, evaluation metrics, tools, and datasets) for supervised machine learning
Research Subject
The explainability, assessment, and trustworthiness of AI model decisions, including explanation tailoring to user needs and related legal and application requirements
Publication Details
Publication Date
2023-04-18
Journal
Publisher
ISSN
Cited by
1704
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai18
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
"Why Should I Trust You?"2016
Distilling the Knowledge in a Neural Network2015
Learning Deep Features for Discriminative Localization2016
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)2018
Image Style Transfer Using Convolutional Neural Networks2016
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects2021
A survey of methods for explaining black box models2019
Towards A Rigorous Science of Interpretable Machine Learning2017
Machine Learning Interpretability: A Survey on Methods and Metrics2019
Power to the People: The Role of Humans in Interactive Machine Learning2014
Artificial Intelligence and Business Value: a Literature Review2021
A Survey on the Explainability of Supervised Machine Learning2021
Interpretable machine learning: Fundamental principles and 10 grand challenges2022
Designing Theory-Driven User-Centric Explainable AI2019
From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI2023
Explainable AI for Healthcare 5.0: Opportunities and Challenges2022
A multilayer multimodal detection and prediction model based on explainable artificial intelligence for Alzheimer’s disease2021
Cited by8
Connecting the dots in trustworthy Artificial Intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation2023
Using artificial intelligence in academic writing and research: An essential productivity tool2024
Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions2024
Integrating permutation feature importance with conformal prediction for robust Explainable Artificial Intelligence in predictive process monitoring2025
Machine Learning for Advanced Emission Monitoring and Reduction Strategies in Fossil Fuel Power Plants2024
Artificial Intelligence in Analytical Chemistry: Towards Yet Undiscovered Opportunities2026
Beyond silos: An integrated AI-blockchain framework for sustainable aquaculture in Ghana2025
Machine learning methods in macroeconomic forecasting: Preliminary results2025