ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning

ClinicalAgent: мультиагентная система для клинических исследований с рассуждением на основе большой языковой модели
Tianfan Fu, Jintai Chen, Ling Yue, Sixue Xing
2024-11-22

PR-AUCReAct reasoningclinical trial predictionlarge language model reasoningmulti-agent system
Large Language Models (LLMs) and multi-agent systems have shown impressive capabilities in natural language tasks but face challenges in clinical trial applications, primarily due to limited access to external knowledge. Recognizing the potential of advanced clinical trial tools that aggregate and predict based on the latest medical data, we propose an integrated solution to enhance their accessibility and utility. We introduce Clinical Agent System (ClinicalAgent), a clinical multi-agent system designed for clinical trial tasks, leveraging GPT-4, multi-agent architectures, LEAST-TO-MOST, and ReAct reasoning technology. This integration not only boosts LLM performance in clinical contexts but also introduces novel functionalities. The proposed method achieves competitive predictive performance in clinical trial outcome prediction (0.7908 PR-AUC), obtaining a 0.3326 improvement over the standard prompt Method. Publicly available code can be found at https://github.com/LeoYML/clinical-agent.
1
ClinicalAgent achieves a PR-AUC of 0.7908 for clinical trial outcome prediction.
2
ClinicalAgent improves PR-AUC by 0.3326 over the standard prompting method.
3
ClinicalAgent is an integrated clinical-trial multi-agent system combining GPT-4, multi-agent architectures, least-to-most prompting, and ReAct reasoning.
4
The system introduces additional clinical-trial functionalities beyond prediction, enabled by its integrated tool-oriented architecture.
5
The system is designed to address LLM limitations in clinical-trial applications, particularly restricted access to external and up-to-date medical knowledge.

Clinical trial tasks and outcomes

LLM-based multi-agent reasoning and predictive performance for clinical trial outcome prediction

Publication Details
Publication Date
2024-11-22
Journal
Publisher
ISSN
Cited by
30
Access Type
Author Information
Authors
Tianfan Fu
Jintai Chen
Ling Yue
Sixue Xing
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%