Practical and ethical challenges of large language models in education: A systematic scoping review
Практические и этические проблемы использования больших языковых моделей в образовании: систематический обзор с картированием исследований
2023-08-06
SCID: 54.1/jpjnytcb
Discuss with AI
educational task automationethical challengeshuman-centred approachlarge language modelssystematic scoping review
Figures from the paper
Abstract (AI)
Abstract Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a range of educational tasks (eg, question generation, feedback provision, and essay grading), there are concerns regarding the practicality and ethicality of these innovations. Such concerns may hinder future research and the adoption of LLMs‐based innovations in authentic educational contexts. To address this, we conducted a systematic scoping review of 118 peer‐reviewed papers published since 2017 to pinpoint the current state of research on using LLMs to automate and support educational tasks. The findings revealed 53 use cases for LLMs in automating education tasks, categorised into nine main categories: profiling/labelling, detection, grading, teaching support, prediction, knowledge representation, feedback, content generation, and recommendation. Additionally, we also identified several practical and ethical challenges, including low technological readiness, lack of replicability and transparency and insufficient privacy and beneficence considerations. The findings were summarised into three recommendations for future studies, including updating existing innovations with state‐of‐the‐art models (eg, GPT‐3/4), embracing the initiative of open‐sourcing models/systems, and adopting a human‐centred approach throughout the developmental process. As the intersection of AI and education is continuously evolving, the findings of this study can serve as an essential reference point for researchers, allowing them to leverage the strengths, learn from the limitations, and uncover potential research opportunities enabled by ChatGPT and other generative AI models. Practitioner notes What is currently known about this topic Generating and analysing text‐based content are time‐consuming and laborious tasks. Large language models are capable of efficiently analysing an unprecedented amount of textual content and completing complex natural language processing and generation tasks. Large language models have been increasingly used to develop educational technologies that aim to automate the generation and analysis of textual content, such as automated question generation and essay scoring. What this paper adds A comprehensive list of different educational tasks that could potentially benefit from LLMs‐based innovations through automation. A structured assessment of the practicality and ethicality of existing LLMs‐based innovations from seven important aspects using established frameworks. Three recommendations that could potentially support future studies to develop LLMs‐based innovations that are practical and ethical to implement in authentic educational contexts. Implications for practice and/or policy Updating existing innovations with state‐of‐the‐art models may further reduce the amount of manual effort required for adapting existing models to different educational tasks. The reporting standards of empirical research that aims to develop educational technologies using large language models need to be improved. Adopting a human‐centred approach throughout the developmental process could contribute to resolving the practical and ethical challenges of large language models in education.
Key Findings
1
A systematic scoping review of 118 peer-reviewed papers identified 53 educational use cases for large language models published since 2017.
2
Major practical and ethical challenges include low technological readiness, limited replicability and transparency, and inadequate consideration of privacy and beneficence.
3
The 53 use cases span nine categories: profiling/labelling, detection, grading, teaching support, prediction, knowledge representation, feedback, content generation, and recommendation.
4
The review recommends updating innovations with state-of-the-art models such as GPT-3/4, open-sourcing models and systems, and applying human-centred development approaches.
5
These challenges may hinder research progress and adoption of LLM-based educational innovations in authentic educational contexts.
Research Object
Use of large language models (LLMs) in educational technologies to automate and support text-based educational tasks
Research Subject
practical and ethical challenges, technological readiness, replicability, transparency, privacy, and beneficence of these innovations in authentic educational contexts
Publication Details
Publication Date
2023-08-06
Journal
Publisher
ISSN
Cited by
1732
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai10
Exploiting Generative AI to Scale up Intelligent Tutoring Systems2023
Systematic review of research on artificial intelligence applications in higher education – where are the educators?2019
Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach2018
ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns2023
How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment2023
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?2023
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey2023
Explainable Artificial Intelligence in education2022
Are We There Yet? - A Systematic Literature Review on Chatbots in Education2021
Evaluating the Effectiveness of Large Language Models in Representing Textual Descriptions of Geometry and Spatial Relations (Short Paper)2023
Cited by10
The promise and challenges of generative AI in education2024
Impact of AI assistance on student agency2023
When LLMs meet cybersecurity: a systematic literature review2025
Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects2023
RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs2025
The effects of generative AI agents and scaffolding on enhancing students’ comprehension of visual learning analytics2025
Large Language Models: A Structured Taxonomy and Review of Challenges, Limitations, Solutions, and Future Directions2025
Agency in the age of generative AI: a critical review of educational implications2026
Agentic AI in Healthcare and Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-Based Agents2026
Unveiling interaction patterns between students and generative AI teachable agent: Focusing on students' agency and AI agents' authority2026