Framework for bias evaluation in large language models in healthcare settings

Система оценки предвзятости больших языковых моделей в условиях здравоохранения
Nasa Sinnott-Armstrong, Junier B. Oliva, Tara Templin, Sophia Fort, Prasanna S. Padmanabham, Pratyush Seshadri, Ram Rimal, Kristin Hassmiller Lich, Sean Sylvia
2025-07-07

audit frameworkbias evaluationclinical decision supporthealthcare settingslarge language models
A critical gap in the adoption of large language models for AI-assisted clinical decisions is the lack of a standardized audit framework to evaluate models for accuracy and bias. Our framework introduces a five-step framework that guides practitioners through stakeholder engagement, model calibration to specific patient populations, and rigorous testing through clinically relevant scenarios. We provide open-access tools for stakeholder engagement and an example of an audit. As the regulation of models becomes more critical, we believe adoption of an audit framework that tests model outputs, rather than regulating specific hyperparameters or inputs, will encourage the responsible use of AI in clinical settings.
1
It introduces a five-step audit framework covering stakeholder engagement, calibration to specific patient populations, and testing with clinically relevant scenarios.
2
The authors argue that regulating and auditing model outputs, rather than prescribing specific hyperparameters or inputs, better supports responsible clinical AI use.
3
The framework is positioned to address increasing regulatory needs while facilitating safer adoption of large language models in healthcare.
4
The framework provides open-access stakeholder-engagement tools and an illustrative audit example for practical adoption.
5
The paper identifies a critical gap: no standardized framework adequately evaluates large language models for both accuracy and bias in clinical decision support.

large language models used for AI-assisted clinical decision-making in healthcare settings

accuracy and bias in model outputs, evaluated through a standardized clinical audit framework across specific patient populations and clinically relevant scenarios

Publication Details
Publication Date
2025-07-07
Journal
Publisher
ISSN
Cited by
61
Access Type
Author Information
Authors
Nasa Sinnott-Armstrong
Junier B. Oliva
Tara Templin
Sophia Fort
Prasanna S. Padmanabham
Pratyush Seshadri
Ram Rimal
Kristin Hassmiller Lich
Sean Sylvia
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%