Bias in data‐driven artificial intelligence systems—An introductory survey

Смещение в управляемых данными системах искусственного интеллекта: вводный обзор
Symeon Papadopoulos, Ioannis Yiannis Kompatsiaris, Salvatore Ruggieri, Franco Turini, Gjergji Kasneci, Wolfgang Nejdl, Ujwal Gadiraju, Katharina E. Kinder-Kurlanda, Claudia Wagner, Steffen Staab, María-Esther Vidal, Miriam Fernández, Eirini Ntoutsi, Pavlos Fafalios, Vasileios Iosifidis, Emmanouil Krasanakis, Fariba Karimi, Harith Alani, Bettina Berendt, Tina Kruegel, Christian Heinze, Klaus Broelemann, Thanassis Tiropanis, Tina Krügel
2020-02-03

AI biasalgorithmic fairnessdata-driven AIfairness in data miningmachine learning
Abstract Artificial Intelligence (AI)‐based systems are widely employed nowadays to make decisions that have far‐reaching impact on individuals and society. Their decisions might affect everyone, everywhere, and anytime, entailing concerns about potential human rights issues. Therefore, it is necessary to move beyond traditional AI algorithms optimized for predictive performance and embed ethical and legal principles in their design, training, and deployment to ensure social good while still benefiting from the huge potential of the AI technology. The goal of this survey is to provide a broad multidisciplinary overview of the area of bias in AI systems, focusing on technical challenges and solutions as well as to suggest new research directions towards approaches well‐grounded in a legal frame. In this survey, we focus on data‐driven AI, as a large part of AI is powered nowadays by (big) data and powerful machine learning algorithms. If otherwise not specified, we use the general term bias to describe problems related to the gathering or processing of data that might result in prejudiced decisions on the bases of demographic features such as race, sex, and so forth. This article is categorized under: Commercial, Legal, and Ethical Issues > Fairness in Data Mining Commercial, Legal, and Ethical Issues > Ethical Considerations Commercial, Legal, and Ethical Issues > Legal Issues
1
AI systems’ widespread use in consequential decisions raises significant human-rights, ethical, and legal concerns affecting individuals and society.
2
Data-driven AI systems can produce prejudiced decisions based on demographic characteristics such as race and sex because of biases in data collection or processing.
3
The paper argues that AI design, training, and deployment should incorporate ethical and legal principles alongside predictive-performance objectives.
4
The survey identifies the need for further research on bias-mitigation approaches grounded in legal frameworks while preserving AI’s societal benefits.
5
The survey provides a multidisciplinary overview of technical challenges and mitigation approaches for bias in data-driven AI systems.

data-driven artificial intelligence systems

bias-related technical, ethical, and legal challenges in data gathering, processing, and decision-making, including approaches to ensure fairness and prevent prejudiced decisions

Publication Details
Publication Date
2020-02-03
Journal
Publisher
ISSN
Cited by
1265
Access Type
Author Information
Authors
Symeon Papadopoulos
Ioannis Yiannis Kompatsiaris
Salvatore Ruggieri
Franco Turini
Gjergji Kasneci
Wolfgang Nejdl
Ujwal Gadiraju
Katharina E. Kinder-Kurlanda
Claudia Wagner
Steffen Staab
María-Esther Vidal
Miriam Fernández
Eirini Ntoutsi
Pavlos Fafalios
Vasileios Iosifidis
Emmanouil Krasanakis
Fariba Karimi
Harith Alani
Bettina Berendt
Tina Kruegel
Christian Heinze
Klaus Broelemann
Thanassis Tiropanis
Tina Krügel
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%