MacAma: Multi‐AI Agent as a Co‐Scientist for Automated Meta‐Analysis

MacAma: мультиагентная система искусственного интеллекта как соучёный для автоматизированного метаанализа
Yilin Yuan, Pingping Li, Yang Wang, Boyuan Zheng, Yingshuang Liu, Dongjin Yang, Hai Lin, Min Wu, Qi Zhao, Jianwei Shuai, Gen Yang
2026-07-29

PRISMA 2020automated meta-analysisevidence synthesismulti-agent frameworkrisk-aware automation
ABSTRACT Meta‐analysis is fundamental to evidence‐based medicine, yet traditional workflows remain labor‐intensive and susceptible to bias. Although LLM‐based research agents offer opportunities for workflow automation, they often lack the data fidelity and methodological traceability required for rigorous quantitative evidence synthesis, particularly when parsing multimodal scientific charts. To address this challenge, we introduce MacAma, a semi‐automated multi‐agent framework for protocol‐constrained and human‐verifiable meta‐analysis. MacAma operationalizes selected PRISMA 2020 reporting items, PICOS‐based eligibility logic, and SYRCLE risk‐of‐bias domains as structured prompts, decision rules, output fields, and audit records. Critically, MacAma adopts a risk‐aware automation strategy: Lower risk, repetitive, and protocol‐driven tasks, such as literature screening and drafting, are delegated to AI agents, whereas high‐impact steps that directly affect effect‐size estimation and statistical conclusions, such as quantitative chart‐data extraction, remain subject to expert verification. In a preclinical radiotherapy case study evaluating tumor‐related immune outcomes and metastatic potential mediated by circulating tumor cells, MacAma achieved competitive screening performance in the evaluated benchmark and reduced the manual screening burden by over 80% within the current workflow. The case study further demonstrates how structured agent outputs, predefined criteria, and audit records can support transparent screening, data extraction, statistical synthesis, and manuscript drafting . These results suggest that MacAma may provide a scalable and auditable framework for AI‐assisted meta‐analysis, although important limitations remain in full‐text access, quantitative chart data extraction, and expert interpretation of heterogeneity. MacAma is open‐source and available at https://github.com/YilinYuan/MacAma .
1
In a preclinical radiotherapy case study, MacAma achieved competitive benchmark screening performance and reduced manual screening workload by over 80%.
2
MacAma delegates lower-risk screening and drafting tasks to AI while requiring expert verification for high-impact quantitative chart-data extraction and statistical conclusions.
3
MacAma is a semi-automated multi-agent framework for protocol-constrained, human-verifiable meta-analysis.
4
The framework operationalizes PRISMA 2020 items, PICOS eligibility logic, and SYRCLE risk-of-bias domains through structured prompts, decision rules, output fields, and audit records.
5
The framework supports transparent evidence-synthesis workflows but remains limited by full-text access, quantitative chart extraction, and expert interpretation of heterogeneity.

MacAma multi-agent framework for semi-automated, protocol-constrained meta-analysis

AI-assisted automation, methodological traceability, data fidelity, and human-verifiable performance of meta-analysis workflows

Publication Details
Publication Date
2026-07-29
Journal
Publisher
ISSN
Cited by
0
Access Type
Author Information
Authors
Yilin Yuan
Pingping Li
Yang Wang
Boyuan Zheng
Yingshuang Liu
Dongjin Yang
Hai Lin
Min Wu
Qi Zhao
Jianwei Shuai
Gen Yang
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%