Algorithmic Bias in Education
Алгоритмическая предвзятость в образовании
2021-11-18
SCID: 54.1/y9c7w85c
Discuss with AI
AIED systemsalgorithmic bias in educationalgorithmic equityfairness metricsmachine learning pipeline
Figures from the paper
Abstract (AI)
In this paper, we review algorithmic bias in education, discussing the causes of that bias and reviewing the empirical literature on the specific ways that algorithmic bias is known to have manifested in education. While other recent work has reviewed mathematical definitions of fairness and expanded algorithmic approaches to reducing bias, our review focuses instead on solidifying the current understanding of the concrete impacts of algorithmic bias in education—which groups are known to be impacted and which stages and agents in the development and deployment of educational algorithms are implicated. We discuss theoretical and formal perspectives on algorithmic bias, connect those perspectives to the machine learning pipeline, and review metrics for assessing bias. Next, we review the evidence around algorithmic bias in education, beginning with the most heavily-studied categories of race/ethnicity, gender, and nationality, and moving to the available evidence of bias for less-studied categories, such as socioeconomic status, disability, and military-connected status. Acknowledging the gaps in what has been studied, we propose a framework for moving from unknown bias to known bias and from fairness to equity. We discuss obstacles to addressing these challenges and propose four areas of effort for mitigating and resolving the problems of algorithmic bias in AIED systems and other educational technology.
Key Findings
1
Empirical evidence is synthesized for bias involving race or ethnicity, gender, and nationality, alongside less-studied categories including socioeconomic status, disability, and military-connected status.
2
The authors propose a framework for progressing from unknown bias to known bias and from fairness toward equity in educational algorithms.
3
The paper connects theoretical and formal perspectives on algorithmic bias to the machine-learning pipeline and reviews metrics for assessing bias.
4
The review focuses on concrete educational impacts of algorithmic bias, identifying affected groups and implicated development and deployment stages.
5
The review identifies obstacles and proposes four areas of effort to mitigate and resolve algorithmic-bias problems in artificial-intelligence-in-education systems and other educational technologies.
Research Object
algorithmic bias in education and educational technology systems
Research Subject
the concrete impacts, affected groups, implicated development and deployment stages and agents, and mitigation of algorithmic bias
Publication Details
Publication Date
2021-11-18
Journal
Publisher
ISSN
Cited by
1415
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai5
Dissecting racial bias in an algorithm used to manage the health of populations2019
Fairness in Machine Learning: A Survey2023
Algorithmic Fairness: Choices, Assumptions, and Definitions2020
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries2019
Algorithmic fairness in education2022
Cited by5
Explainable Artificial Intelligence in education2022
Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions2024
AI ‐driven adaptive learning for sustainable educational transformation2024
The impact of generative artificial intelligence on socioeconomic inequalities and policy making2024
Debiasing Education Algorithms2024