Can an AI Agent Replace Human Examiners in High-Stakes Interactive Speaking Tests? A Debate

Может ли ИИ-агент заменить экзаменаторов-людей в интерактивных устных экзаменах с высокими ставками? Дискуссия
Jing Xu, Lynda Taylor, Xiaoming Xi, Yasin Karatay, Shangchao Min, Carsten Roever
2026-07-19

AI agentsfairness in AIhigh-stakes speaking testslanguage assessmentspoken dialogue systems
Generative artificial intelligence (GenAI) is advancing at a remarkable speed, and its promise in transforming current practice in language assessment has been articulated by applied linguistics researchers. An emerging application of GenAI is to integrate the technology into Spoken Dialogue Systems (SDSs) to simulate human interlocutors for the purpose of speaking practice or assessment. Despite rapid technological advances, the issue of whether an AI agent can replace a human examiner in one-on-one, high-stakes interactive speaking tests remains contentious. Building on a lively academic debate on this topic at the 2025 Language Testing Research Colloquium (LTRC) in Bangkok, this Viewpoint presents arguments both for and against this proposition in terms of construct theory, practicality, washback, fairness, ethical uses of AI, and so forth.
1
It presents a balanced debate rather than an empirical validation, outlining arguments for and against AI examiner replacement.
2
The debate evaluates the proposition through construct theory, practicality, washback, fairness, and ethical uses of artificial intelligence.
3
The discussion is based on an academic debate held at the 2025 Language Testing Research Colloquium in Bangkok.
4
The paper examines whether GenAI-driven spoken dialogue systems can replace human examiners in one-on-one, high-stakes interactive speaking tests.

AI agents integrated into Spoken Dialogue Systems for one-on-one, high-stakes interactive speaking tests

Whether AI agents can replace human examiners, including the implications for construct validity, practicality, washback, fairness, and ethical AI use

Publication Details
Publication Date
2026-07-19
Journal
Publisher
ISSN
Cited by
0
Access Type
Author Information
Authors
Jing Xu
Lynda Taylor
Xiaoming Xi
Yasin Karatay
Shangchao Min
Carsten Roever
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%