ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning
ClinicalAgent: мультиагентная система для клинических исследований с рассуждением на основе большой языковой модели
2024-11-22
SCID: 54.1/eje8e764
Discuss with AI
PR-AUCReAct reasoningclinical trial predictionlarge language model reasoningmulti-agent system
Figures from the paper
Abstract (AI)
Large Language Models (LLMs) and multi-agent systems have shown impressive capabilities in natural language tasks but face challenges in clinical trial applications, primarily due to limited access to external knowledge. Recognizing the potential of advanced clinical trial tools that aggregate and predict based on the latest medical data, we propose an integrated solution to enhance their accessibility and utility. We introduce Clinical Agent System (ClinicalAgent), a clinical multi-agent system designed for clinical trial tasks, leveraging GPT-4, multi-agent architectures, LEAST-TO-MOST, and ReAct reasoning technology. This integration not only boosts LLM performance in clinical contexts but also introduces novel functionalities. The proposed method achieves competitive predictive performance in clinical trial outcome prediction (0.7908 PR-AUC), obtaining a 0.3326 improvement over the standard prompt Method. Publicly available code can be found at https://github.com/LeoYML/clinical-agent.
Key Findings
1
ClinicalAgent achieves a PR-AUC of 0.7908 for clinical trial outcome prediction.
2
ClinicalAgent improves PR-AUC by 0.3326 over the standard prompting method.
3
ClinicalAgent is an integrated clinical-trial multi-agent system combining GPT-4, multi-agent architectures, least-to-most prompting, and ReAct reasoning.
4
The system introduces additional clinical-trial functionalities beyond prediction, enabled by its integrated tool-oriented architecture.
5
The system is designed to address LLM limitations in clinical-trial applications, particularly restricted access to external and up-to-date medical knowledge.
Research Object
Clinical trial tasks and outcomes
Research Subject
LLM-based multi-agent reasoning and predictive performance for clinical trial outcome prediction
Publication Details
Publication Date
2024-11-22
Journal
Publisher
ISSN
Cited by
30
Access Type
Author Information
Download PDF
Subscribe to digest