Trust in AI: progress, challenges, and future directions
Доверие к искусственному интеллекту: прогресс, проблемы и перспективные направления
2024-11-18
SCID: 54.1/nu3hk9zj
Discuss with AI
AI trustworthiness metricshuman–machine interactiontechnology acceptancetrust in AItrustworthy AI
Figures from the paper
Abstract (AI)
The increasing use of artificial intelligence (AI) systems in our daily lives through various applications, services, and products highlights the significance of trust and distrust in AI from a user perspective. AI-driven systems have significantly diffused into various aspects of our lives, serving as beneficial “tools” used by human agents. These systems are also evolving to act as co-assistants or semi-agents in specific domains, potentially influencing human thought, decision-making, and agency. Trust and distrust in AI serve as regulators and could significantly control the level of this diffusion, as trust can increase, and distrust may reduce the rate of adoption of AI. Recently, a variety of studies focused on the different dimensions of trust and distrust in AI and its relevant considerations. In this systematic literature review, after conceptualizing trust in the current AI literature, we will investigate trust in different types of human–machine interaction and its impact on technology acceptance in different domains. Additionally, we propose a taxonomy of technical (i.e., safety, accuracy, robustness) and non-technical axiological (i.e., ethical, legal, and mixed) trustworthiness metrics, along with some trustworthy measurements. Moreover, we examine major trust-breakers in AI (e.g., autonomy and dignity threats) and trustmakers; and propose some future directions and probable solutions for the transition to a trustworthy AI.
Key Findings
1
The paper outlines future research directions and potential solutions for transitioning toward trustworthy AI.
2
The paper proposes a taxonomy of AI trustworthiness metrics covering technical properties such as safety, accuracy, and robustness, and axiological properties such as ethical and legal considerations.
3
The review conceptualizes trust in AI across different types of human–machine interaction and examines its effects on technology acceptance across domains.
4
The review identifies major AI trust-breakers, including threats to human autonomy and dignity, alongside factors that can build trust.
5
Trust and distrust regulate AI diffusion and adoption by influencing users’ acceptance of AI systems.
Research Object
AI systems in human–machine interactions
Research Subject
Trust and distrust in AI, including their dimensions, trustworthiness metrics, determinants, effects on technology acceptance, and mechanisms of trust formation and breakdown
Publication Details
Publication Date
2024-11-18
Journal
Publisher
ISSN
Cited by
705
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai9
Towards A Rigorous Science of Interpretable Machine Learning2017
Machine Learning Interpretability: A Survey on Methods and Metrics2019
The Ethics of AI Ethics: An Evaluation of Guidelines2020
Artificial Intelligence Risk Management Framework (AI RMF 1.0)2023
AI-based chatbots in customer service and their effects on user compliance2020
Trustworthy artificial intelligence2020
Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness2020
Interpretability of machine learning‐based prediction models in healthcare2020
Trust, transparency, and openness: How inclusion of cultural values shapes Nordic national public policy strategies for artificial intelligence (AI)2020
Cited by7
AI Agents and Agentic Systems: A Multi-Expert Analysis2025
Decision-Making in Complex Systems Using AI-Based Decision Support: The Role of Trust, Transparency, and Data Quality2026
CASA in Action: Dual Trust Pathways from Technical–Social Features of AI Agents to Users’ Active Engagement Through Cognitive–Emotional Trust2026
Selective Consolidation in AI Agent Research: A Co-Citation Analysis of Its Intellectual Structure and Relevance for Human–Computer Interaction2026
AI-Generated Hypotheses and the Emergence of Autonomous Scientific Discovery2026
Human trust and intention to use intelligent agents: the impact of intelligent agents’ ability to understand human intentions and emotions2026
Agentic AI Arrives: How Gen Z Adopts Autonomous AI Agents2026