Bias in data‐driven artificial intelligence systems—An introductory survey
Смещение в управляемых данными системах искусственного интеллекта: вводный обзор
2020-02-03
SCID: 54.1/sgbztnwy
Discuss with AI
AI biasalgorithmic fairnessdata-driven AIfairness in data miningmachine learning
Figures from the paper
Abstract (AI)
Abstract Artificial Intelligence (AI)‐based systems are widely employed nowadays to make decisions that have far‐reaching impact on individuals and society. Their decisions might affect everyone, everywhere, and anytime, entailing concerns about potential human rights issues. Therefore, it is necessary to move beyond traditional AI algorithms optimized for predictive performance and embed ethical and legal principles in their design, training, and deployment to ensure social good while still benefiting from the huge potential of the AI technology. The goal of this survey is to provide a broad multidisciplinary overview of the area of bias in AI systems, focusing on technical challenges and solutions as well as to suggest new research directions towards approaches well‐grounded in a legal frame. In this survey, we focus on data‐driven AI, as a large part of AI is powered nowadays by (big) data and powerful machine learning algorithms. If otherwise not specified, we use the general term bias to describe problems related to the gathering or processing of data that might result in prejudiced decisions on the bases of demographic features such as race, sex, and so forth. This article is categorized under: Commercial, Legal, and Ethical Issues > Fairness in Data Mining Commercial, Legal, and Ethical Issues > Ethical Considerations Commercial, Legal, and Ethical Issues > Legal Issues
Key Findings
1
AI systems’ widespread use in consequential decisions raises significant human-rights, ethical, and legal concerns affecting individuals and society.
2
Data-driven AI systems can produce prejudiced decisions based on demographic characteristics such as race and sex because of biases in data collection or processing.
3
The paper argues that AI design, training, and deployment should incorporate ethical and legal principles alongside predictive-performance objectives.
4
The survey identifies the need for further research on bias-mitigation approaches grounded in legal frameworks while preserving AI’s societal benefits.
5
The survey provides a multidisciplinary overview of technical challenges and mitigation approaches for bias in data-driven AI systems.
Research Object
data-driven artificial intelligence systems
Research Subject
bias-related technical, ethical, and legal challenges in data gathering, processing, and decision-making, including approaches to ensure fairness and prevent prejudiced decisions
Publication Details
Publication Date
2020-02-03
Journal
Publisher
ISSN
Cited by
1265
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai4
Cited by9
New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution2023
Artificial Intelligence and Business Value: a Literature Review2021
Artificial intelligence in the creative industries: a review2021
Generative artificial intelligence2023
Six Human-Centered Artificial Intelligence Grand Challenges2023
The Impact of Artificial Intelligence on Workers’ Skills: Upskilling and Reskilling in Organisations2023
Mental-LLM2024
Exploring collaborative decision-making: A quasi-experimental study of human and Generative AI interaction2024
Explainable Artificial Intelligence (XAI) in Insurance2022