MacAma: Multi‐AI Agent as a Co‐Scientist for Automated Meta‐Analysis
MacAma: мультиагентная система искусственного интеллекта как соучёный для автоматизированного метаанализа
2026-07-29
SCID: 54.1/q9ndnkmm
Discuss with AI
PRISMA 2020automated meta-analysisevidence synthesismulti-agent frameworkrisk-aware automation
Figures from the paper
Abstract (AI)
ABSTRACT Meta‐analysis is fundamental to evidence‐based medicine, yet traditional workflows remain labor‐intensive and susceptible to bias. Although LLM‐based research agents offer opportunities for workflow automation, they often lack the data fidelity and methodological traceability required for rigorous quantitative evidence synthesis, particularly when parsing multimodal scientific charts. To address this challenge, we introduce MacAma, a semi‐automated multi‐agent framework for protocol‐constrained and human‐verifiable meta‐analysis. MacAma operationalizes selected PRISMA 2020 reporting items, PICOS‐based eligibility logic, and SYRCLE risk‐of‐bias domains as structured prompts, decision rules, output fields, and audit records. Critically, MacAma adopts a risk‐aware automation strategy: Lower risk, repetitive, and protocol‐driven tasks, such as literature screening and drafting, are delegated to AI agents, whereas high‐impact steps that directly affect effect‐size estimation and statistical conclusions, such as quantitative chart‐data extraction, remain subject to expert verification. In a preclinical radiotherapy case study evaluating tumor‐related immune outcomes and metastatic potential mediated by circulating tumor cells, MacAma achieved competitive screening performance in the evaluated benchmark and reduced the manual screening burden by over 80% within the current workflow. The case study further demonstrates how structured agent outputs, predefined criteria, and audit records can support transparent screening, data extraction, statistical synthesis, and manuscript drafting . These results suggest that MacAma may provide a scalable and auditable framework for AI‐assisted meta‐analysis, although important limitations remain in full‐text access, quantitative chart data extraction, and expert interpretation of heterogeneity. MacAma is open‐source and available at https://github.com/YilinYuan/MacAma .
Key Findings
1
In a preclinical radiotherapy case study, MacAma achieved competitive benchmark screening performance and reduced manual screening workload by over 80%.
2
MacAma delegates lower-risk screening and drafting tasks to AI while requiring expert verification for high-impact quantitative chart-data extraction and statistical conclusions.
3
MacAma is a semi-automated multi-agent framework for protocol-constrained, human-verifiable meta-analysis.
4
The framework operationalizes PRISMA 2020 items, PICOS eligibility logic, and SYRCLE risk-of-bias domains through structured prompts, decision rules, output fields, and audit records.
5
The framework supports transparent evidence-synthesis workflows but remains limited by full-text access, quantitative chart extraction, and expert interpretation of heterogeneity.
Research Object
MacAma multi-agent framework for semi-automated, protocol-constrained meta-analysis
Research Subject
AI-assisted automation, methodological traceability, data fidelity, and human-verifiable performance of meta-analysis workflows
Publication Details
Publication Date
2026-07-29
Journal
Publisher
ISSN
Cited by
0
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest