Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence

Объяснимый искусственный интеллект (XAI): что нам известно и чего еще необходимо достичь для создания заслуживающего доверия искусственного интеллекта
Natalia Díaz-Rodríguez, Javier Del Ser, Francisco Herrera, Shaker El–Sappagh, Tamer Abuhmed, Riccardo Guidotti, Roberto Confalonieri, Sajid Ali, Khan Muhammad, José M. Alonso
2023-04-18

Explainable artificial intelligenceExplanation evaluation metricsPost-hoc explainabilityTrustworthy artificial intelligenceXAI datasets
Artificial intelligence (AI) is currently being utilized in a wide range of sophisticated applications, but the outcomes of many AI models are challenging to comprehend and trust due to their black-box nature. Usually, it is essential to understand the reasoning behind an AI model’s decision-making. Thus, the need for eXplainable AI (XAI) methods for improving trust in AI models has arisen. XAI has become a popular research subject within the AI field in recent years. Existing survey papers have tackled the concepts of XAI, its general terms, and post-hoc explainability methods but there have not been any reviews that have looked at the assessment methods, available tools, XAI datasets, and other related aspects. Therefore, in this comprehensive study, we provide readers with an overview of the current research and trends in this rapidly emerging area with a case study example. The study starts by explaining the background of XAI, common definitions, and summarizing recently proposed techniques in XAI for supervised machine learning. The review divides XAI techniques into four axes using a hierarchical categorization system: (i) data explainability, (ii) model explainability, (iii) post-hoc explainability, and (iv) assessment of explanations. We also introduce available evaluation metrics as well as open-source packages and datasets with future research directions. Then, the significance of explainability in terms of legal demands, user viewpoints, and application orientation is outlined, termed as XAI concerns. This paper advocates for tailoring explanation content to specific user types. An examination of XAI techniques and evaluation was conducted by looking at 410 critical articles, published between January 2016 and October 2022, in reputed journals and using a wide range of research databases as a source of information. The article is aimed at XAI researchers who are interested in making their AI models more trustworthy, as well as towards researchers from other disciplines who are looking for effective XAI methods to complete tasks with confidence while communicating meaning from data.
1
It argues that explanations should be tailored to specific user types, considering legal requirements, user perspectives, and application contexts.
2
It organizes supervised-machine-learning XAI techniques into four hierarchical axes: data explainability, model explainability, post-hoc explainability, and explanation assessment.
3
The analysis examines 410 critical articles published between January 2016 and October 2022 to characterize XAI research and its role in trustworthy AI.
4
The review identifies a gap in prior XAI surveys by comprehensively covering assessment methods, tools, datasets, and related research aspects.
5
The study summarizes evaluation metrics, open-source XAI packages, datasets, current research trends, and proposed future research directions.

Explainable Artificial Intelligence (XAI) methods and their ecosystem (techniques, evaluation metrics, tools, and datasets) for supervised machine learning

The explainability, assessment, and trustworthiness of AI model decisions, including explanation tailoring to user needs and related legal and application requirements

Publication Details
Publication Date
2023-04-18
Journal
Publisher
ISSN
Cited by
1704
Access Type
Author Information
Authors
Natalia Díaz-Rodríguez
Javier Del Ser
Francisco Herrera
Shaker El–Sappagh
Tamer Abuhmed
Riccardo Guidotti
Roberto Confalonieri
Sajid Ali
Khan Muhammad
José M. Alonso
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%