Evaluating large language model workflows in clinical decision support for triage and referral and diagnosis

Оценка рабочих процессов на основе больших языковых моделей для поддержки клинических решений при сортировке, направлении к специалистам и диагностике
Farieda Gaber, Maqsood Shaik, Fabio Allega, Agnes Julia Bilecz, Felix Busch, Kelsey Goon, Vedran Franke, Altuna Akalin, Agnes Julia Bilecz
2025-05-09

MIMIC databaseclinical decision supportlarge language modelsretrieval-augmented generationtriage and referral
Accurate medical decision-making is critical for both patients and clinicians. Patients often struggle to interpret their symptoms, determine their severity, and select the right specialist. Simultaneously, clinicians face challenges in integrating complex patient data to make timely, accurate diagnoses. Recent advances in large language models (LLMs) offer the potential to bridge this gap by supporting decision-making for both patients and healthcare providers. In this study, we benchmark multiple LLM versions and an LLM-based workflow incorporating retrieval-augmented generation (RAG) on a curated dataset of 2000 medical cases derived from the Medical Information Mart for Intensive Care database. Our findings show that these LLMs are capable of providing personalized insights into likely diagnoses, suggesting appropriate specialists, and assessing urgent care needs. These models may also support clinicians in refining diagnoses and decision-making, offering a promising approach to improving patient outcomes and streamlining healthcare delivery.
1
LLM-based decision support may help clinicians refine diagnoses and make more timely, accurate decisions from complex patient information.
2
The evaluated models provide personalized insights into likely diagnoses, recommend appropriate medical specialists, and assess patients’ urgent-care needs.
3
The findings indicate potential for LLM workflows to improve patient outcomes and streamline healthcare delivery, although the abstract does not report quantitative performance comparisons.
4
The study benchmarks multiple large language model versions and a retrieval-augmented generation workflow using 2,000 curated medical cases from the MIMIC database.

large language model workflows for clinical decision support

their performance in triage, specialist referral, diagnosis, and assessment of urgent-care needs for patients and clinicians

Publication Details
Publication Date
2025-05-09
Journal
Publisher
ISSN
Cited by
164
Access Type
Author Information
Authors
Farieda Gaber
Maqsood Shaik
Fabio Allega
Agnes Julia Bilecz
Felix Busch
Kelsey Goon
Vedran Franke
Altuna Akalin
Agnes Julia Bilecz
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%