Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions
Объяснимая Искусственная Интеллектуальная Система (XAI) 2.0: Манифест открытых проблем и междисциплинарных направлений исследований
2024-02-15
SCID: 54.1/8s8btnnk
Discuss with AI
Explainable Artificial Intelligence (XAI)XAI manifestoXAI open problemsexplainability in real-world applicationsinterdisciplinary research directions
Figures from the paper
Abstract (AI)
Understanding black box models has become paramount as systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications. In response, Explainable AI (XAI) has emerged as a field of research with practical and ethical benefits across various domains. This paper highlights the advancements in XAI and its application in real-world scenarios and addresses the ongoing challenges within XAI, emphasizing the need for broader perspectives and collaborative efforts. We bring together experts from diverse fields to identify open problems, striving to synchronize research agendas and accelerate XAI in practical applications. By fostering collaborative discussion and interdisciplinary cooperation, we aim to propel XAI forward, contributing to its continued success. We aim to develop a comprehensive proposal for advancing XAI. To achieve this goal, we present a manifesto of 28 open problems categorized into nine categories. These challenges encapsulate the complexities and nuances of XAI and offer a road map for future research. For each problem, we provide promising research directions in the hope of harnessing the collective intelligence of interested stakeholders.
Key Findings
1
A manifesto of 28 open problems in XAI is presented, organized into nine categories to capture XAI's complexities and research priorities.
2
Advancing XAI requires broader perspectives, collaborative efforts, and synchronization of research agendas to translate methods into real-world impact.
3
For each of the 28 problems the paper provides promising research directions aimed at fostering interdisciplinary collaboration and accelerating progress.
4
The paper synthesizes perspectives from experts across disciplines to identify open problems and align research agendas for practical XAI deployment.
5
XAI remains critical as opaque AI systems proliferate across diverse real-world applications, creating practical and ethical needs for explainability.
Research Object
Explainable Artificial Intelligence (XAI) as a research field and its open problems
Research Subject
Identification, categorization, and formulation of the key open challenges and interdisciplinary research directions (28 problems in nine categories) needed to advance XAI toward practical, ethical, and collaborative applications
Publication Details
Publication Date
2024-02-15
Journal
Publisher
ISSN
Cited by
572
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai18
A Unified Approach to Interpreting Model Predictions2017
"Why Should I Trust You?": Explaining the Predictions of Any Classifier2016
Systematic review of research on artificial intelligence applications in higher education – where are the educators?2019
Proceedings of the 24th international conference on Machine learning2007
Towards A Rigorous Science of Interpretable Machine Learning2017
Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining2016
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)2018
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI2020
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective2020
Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence2023
Machine Learning Interpretability: A Survey on Methods and Metrics2019
Algorithmic Bias in Education2021
Connecting the dots in trustworthy Artificial Intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation2023
A Survey of Methods for Explaining Black Box Models2018
Evaluating the Quality of Machine Learning Explanations: A Survey on Methods and Metrics2021
Explainable Artificial Intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunities2022
From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI2023
Algorithmic fairness in education2022