A self-correcting Agentic Graph RAG for clinical decision support in hepatology

Самокорректирующийся агентный Graph RAG для поддержки принятия клинических решений в гепатологии
Qingqing Zhou, Jili Hu, Zhi Li, Fang Fang, Ya Li, Yalan Hu, Wenjie Xuan
2025-12-16

Agentic Graph RAGLLM hallucinationsclinical decision supporthepatology knowledge graphself-correcting retrieve-evaluate-refine loop
Introduction: Clinical decision-making in hepatology is currently challenged by the rapid expansion of medical knowledge and the limitations of Large Language Models (LLMs), specifically their unreliability and tendency to hallucinate. Furthermore, standard Retrieval-Augmented Generation (RAG) paradigms often fail to effectively leverage complex medical knowledge structures. Methods: To address these issues, we propose an Agentic Graph RAG framework built upon a clinically-verified hepatology knowledge graph. Our approach utilizes a state-driven agentic system employing a self-correcting "retrieve-evaluate-refine" loop. Within this workflow, agents dynamically generate, semantically validate, assess, and iteratively optimize graph search strategies to construct a comprehensive and accurate context, which is then used by an LLM to generate reliable responses. Results: The framework was evaluated on a custom dataset of clinical questions. It significantly outperformed baseline models (including GPT-4, standard RAG, and Graph RAG) across all evaluation metrics. Specifically, our model achieved superior scores in faithfulness (0.94), context recall (0.92), and answer relevancy (0.91). Discussion: This agentic approach effectively mitigates LLM hallucinations and provides accurate, interpretable answers. These findings demonstrate the framework's potential as a robust, next-generation intelligent clinical decision support tool for hepatology.
1
Achieved faithfulness of 0.94, context recall of 0.92, and answer relevancy of 0.91.
2
Introduces an Agentic Graph RAG framework built on a clinically verified hepatology knowledge graph for clinical decision support.
3
The approach mitigates LLM hallucinations while producing accurate and interpretable hepatology answers, supporting its potential as a robust clinical decision-support tool.
4
The framework significantly outperformed GPT-4, standard RAG, and Graph RAG across all evaluation metrics on a custom clinical-question dataset.
5
Uses a state-driven self-correcting “retrieve-evaluate-refine” loop to generate, validate, assess, and optimize graph-search strategies.

Agentic Graph RAG framework for hepatology clinical decision support

Self-correcting retrieval, evaluation, and refinement performance for generating faithful, relevant, and accurate clinical answers

Publication Details
Publication Date
2025-12-16
Journal
Publisher
ISSN
Cited by
9
Access Type
Author Information
Authors
Qingqing Zhou
Jili Hu
Zhi Li
Fang Fang
Ya Li
Yalan Hu
Wenjie Xuan
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%