A large language model digital patient system enhances ophthalmology history taking skills
Система цифрового пациента на основе большой языковой модели улучшает навыки сбора анамнеза в офтальмологии
2025-08-04
SCID: 54.1/qrwmv9sy
Discuss with AI
digital patientlarge language modelmedical history-takingophthalmology educationretrieval-augmented framework
Figures from the paper
Abstract (AI)
Clinical trainees face limited opportunities to practice medical history-taking skills due to scarce case diversity and access to real patients. To address this, we developed a large language model-based digital patient (LLMDP) system that transforms de‑identified electronic health records into voice‑enabled virtual patients capable of free‑text dialog and adaptive feedback, based on our previously established open-source retrieval-augmented framework. In a single‑center randomized controlled trial (ClinicalTrials.gov: NCT06229379; N = 84), students trained with LLMDP achieved a 10.50-point increase in medical history-taking assessment scores (95% CI: 4.66-16.33, p < 0.001) compared to those using traditional methods. LLMDP-trained students also demonstrated greater empathy. Participants reported high satisfaction with LLMDP, emphasizing its role in reducing training costs and boosting confidence for real patient interactions. These findings provide evidence that LLM-driven digital patients enhance medical history-taking skills and offer a scalable, low-risk pathway for integrating generative AI into ophthalmology education.
Key Findings
1
A voice-enabled large language model digital patient system transforms de-identified electronic health records into adaptive virtual history-taking encounters.
2
In a single-center randomized controlled trial of 84 students, LLMDP training increased history-taking assessment scores by 10.50 points versus traditional methods (95% CI: 4.66–16.33; p < 0.001).
3
Participants reported high satisfaction, citing reduced training costs and increased confidence for interactions with real patients.
4
Students trained with LLMDP demonstrated greater empathy than those using traditional training methods.
5
The system offers a scalable, low-risk approach for integrating generative AI into ophthalmology education.
Research Object
LLM-based digital patient system for ophthalmology history-taking training
Research Subject
The system’s effectiveness in enhancing medical history-taking skills, empathy, confidence, and training satisfaction among clinical trainees
Publication Details
Publication Date
2025-08-04
Journal
Publisher
ISSN
Cited by
39
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai5
Large language models encode clinical knowledge2023
How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment2023
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine2023
Digital twins for health: a scoping review2024
Diagnostic reasoning prompts reveal the potential for large language model interpretability in medicine2024