An autonomous multimodal AI agent for evidence-grounded ophthalmic diagnosis
Автономный мультимодальный ИИ-агент для офтальмологической диагностики на основе доказательств
2026-08-01
SCID: 54.1/9d66cxfu
Discuss with AI
B-scan ultrasonographyautonomous AI agentevidence-grounded reportingfundus photographymultimodal ophthalmic diagnosis
Figures from the paper
Abstract (AI)
Multimodal ophthalmic diagnosis requires integrating fundus photography, B-scan ultrasonography, and medical evidence, yet most artificial intelligence (AI) systems remain single-task or weakly grounded. AgentEYE is an auditable multimodal agent that routes ocular images to specialized fundus and B-scan tools, retrieves guideline/web evidence, and synthesizes evidence-grounded reports. In a 302-case internal benchmark, AgentEYE shows higher diagnostic correctness and completeness than large language model (LLM)-only baselines and an ablation without specialized imaging tools; performance remains similar to the no-retrieval ablation, indicating that retrieval mainly supports evidence grounding and citation auditability. Blinded evaluation of 200 cases by three ophthalmologists confirms improved diagnostic correctness, completeness, safety, and citation grounding versus an LLM-only self-citation baseline. External analyses show distribution-dependent performance. These findings support AgentEYE as a traceable decision-support prototype requiring prospective multicenter validation.
Key Findings
1
AgentEYE integrates fundus photography, B-scan ultrasonography, and retrieved medical evidence through specialized tools to generate auditable ophthalmic diagnostic reports.
2
Blinded assessment of 200 cases by three ophthalmologists found AgentEYE improved diagnostic correctness, completeness, safety, and citation grounding compared with an LLM-only self-citation baseline.
3
External analyses revealed distribution-dependent performance, supporting the need for prospective multicenter validation before clinical use.
4
On a 302-case internal benchmark, AgentEYE achieved higher diagnostic correctness and completeness than LLM-only baselines and a version without specialized imaging tools.
5
Removing evidence retrieval produced similar diagnostic performance, indicating retrieval primarily improves evidence grounding and citation auditability rather than diagnosis.
Research Object
AgentEYE, an autonomous multimodal AI agent for ophthalmic diagnosis using fundus photography, B-scan ultrasonography, and medical evidence
Research Subject
evidence-grounded ophthalmic diagnostic performance, including diagnostic correctness, completeness, safety, traceability, and citation grounding
Publication Details
Publication Date
2026-08-01
Journal
Publisher
ISSN
Cited by
0
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest