Conversational agents in healthcare: a systematic review
Разговорные агенты в здравоохранении: систематический обзор
2018-05-21
SCID: 54.1/6x65ha5h
Discuss with AI
dialogue management strategieshealthcare conversational agentspatient safetysystematic reviewunconstrained natural language input
Figures from the paper
Abstract (AI)
Objective: Our objective was to review the characteristics, current applications, and evaluation measures of conversational agents with unconstrained natural language input capabilities used for health-related purposes. Methods: We searched PubMed, Embase, CINAHL, PsycInfo, and ACM Digital using a predefined search strategy. Studies were included if they focused on consumers or healthcare professionals; involved a conversational agent using any unconstrained natural language input; and reported evaluation measures resulting from user interaction with the system. Studies were screened by independent reviewers and Cohen's kappa measured inter-coder agreement. Results: The database search retrieved 1513 citations; 17 articles (14 different conversational agents) met the inclusion criteria. Dialogue management strategies were mostly finite-state and frame-based (6 and 7 conversational agents, respectively); agent-based strategies were present in one type of system. Two studies were randomized controlled trials (RCTs), 1 was cross-sectional, and the remaining were quasi-experimental. Half of the conversational agents supported consumers with health tasks such as self-care. The only RCT evaluating the efficacy of a conversational agent found a significant effect in reducing depression symptoms (effect size d = 0.44, p = .04). Patient safety was rarely evaluated in the included studies. Conclusions: The use of conversational agents with unconstrained natural language input capabilities for health-related purposes is an emerging field of research, where the few published studies were mainly quasi-experimental, and rarely evaluated efficacy or safety. Future studies would benefit from more robust experimental designs and standardized reporting. Protocol Registration: The protocol for this systematic review is registered at PROSPERO with the number CRD42017065917.
Key Findings
1
Dialogue management was predominantly finite-state or frame-based, used by 6 and 7 conversational agents respectively; agent-based strategies appeared in one system.
2
Half of the conversational agents supported consumers with health-related tasks, including self-care.
3
Only two studies were randomized controlled trials, while most were quasi-experimental; efficacy and safety were rarely evaluated.
4
The field remains emerging, requiring more robust experimental designs and standardized reporting, particularly for efficacy and patient safety.
5
The sole RCT assessing efficacy found that a conversational agent significantly reduced depression symptoms, with effect size d = 0.44 and p = .04.
6
The systematic review identified 17 eligible articles evaluating 14 conversational agents with unconstrained natural-language input for health-related purposes.
Research Object
Conversational agents with unconstrained natural language input used for health-related purposes
Research Subject
Characteristics, applications, evaluation measures, efficacy, and safety of these conversational agents
Publication Details
Publication Date
2018-05-21
Journal
Publisher
ISSN
Cited by
1434
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai1
Cited by8
Drivers, barriers and social considerations for AI adoption in business and management: A tertiary study2020
AI-generated characters for supporting personalized learning and well-being2021
Artificial intelligence empowered conversational agents: A systematic literature review and research agenda2023
Artificial Intelligence Chatbot Behavior Change Model for Designing Artificial Intelligence Chatbots to Promote Physical Activity and a Healthy Diet: Viewpoint2020
Artificial Intelligence-Based Conversational Agents for Chronic Conditions: Systematic Literature Review2020
Research hypothesis generation over scientific knowledge graphs2025
Exploring Body Image Awareness With a Large Language Model–Based Conversational Agent: Qualitative Study With Young Adults2025
Selective Consolidation in AI Agent Research: A Co-Citation Analysis of Its Intellectual Structure and Relevance for Human–Computer Interaction2026