The ethics of ChatGPT in medicine and healthcare: a systematic review on Large Language Models (LLMs)
Этика ChatGPT в медицине и здравоохранении: систематический обзор больших языковых моделей (LLM)
2024-07-08
SCID: 54.1/zehff2mt
Discuss with AI
ChatGPTLarge Language Modelsalgorithmic biashealthcare ethicshuman oversight
Figures from the paper
Abstract (AI)
With the introduction of ChatGPT, Large Language Models (LLMs) have received enormous attention in healthcare. Despite potential benefits, researchers have underscored various ethical implications. While individual instances have garnered attention, a systematic and comprehensive overview of practical applications currently researched and ethical issues connected to them is lacking. Against this background, this work maps the ethical landscape surrounding the current deployment of LLMs in medicine and healthcare through a systematic review. Electronic databases and preprint servers were queried using a comprehensive search strategy which generated 796 records. Studies were screened and extracted following a modified rapid review approach. Methodological quality was assessed using a hybrid approach. For 53 records, a meta-aggregative synthesis was performed. Four general fields of applications emerged showcasing a dynamic exploration phase. Advantages of using LLMs are attributed to their capacity in data analysis, information provisioning, support in decision-making or mitigating information loss and enhancing information accessibility. However, our study also identifies recurrent ethical concerns connected to fairness, bias, non-maleficence, transparency, and privacy. A distinctive concern is the tendency to produce harmful or convincing but inaccurate content. Calls for ethical guidance and human oversight are recurrent. We suggest that the ethical guidance debate should be reframed to focus on defining what constitutes acceptable human oversight across the spectrum of applications. This involves considering the diversity of settings, varying potentials for harm, and different acceptable thresholds for performance and certainty in healthcare. Additionally, critical inquiry is needed to evaluate the necessity and justification of LLMs' current experimental use.
Key Findings
1
A systematic review mapped ethical issues across current and emerging applications of ChatGPT and other LLMs in medicine and healthcare.
2
Four broad application fields emerged, reflecting a dynamic experimental phase in healthcare LLM deployment.
3
Further critical evaluation is needed to determine whether current experimental uses of LLMs are necessary and justified.
4
Recurring ethical concerns involve fairness, bias, non-maleficence, transparency, privacy, and the generation of harmful or convincing but inaccurate content.
5
Reported benefits include data analysis, information provision, decision-making support, reduced information loss, and improved information accessibility.
6
The review calls for human oversight and recommends defining acceptable oversight according to application context, harm potential, performance, and certainty requirements.
7
The review screened 796 records and synthesized findings from 53 records using a meta-aggregative approach.
Research Object
Large Language Models (LLMs, specifically ChatGPT) deployed in medicine and healthcare
Research Subject
Their practical applications and associated ethical implications, including fairness, bias, non-maleficence, transparency, privacy, harmful inaccuracies, and requirements for human oversight
Publication Details
Publication Date
2024-07-08
Journal
Publisher
ISSN
Cited by
389
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai12
Dissecting racial bias in an algorithm used to manage the health of populations2019
Large language models encode clinical knowledge2023
ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns2023
On the Opportunities and Risks of Foundation Models2021
Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media Forum2023
ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope2023
The Ethics of AI Ethics: An Evaluation of Guidelines2020
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine2023
The future landscape of large language models in medicine2023
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health2023
Generating scholarly content with ChatGPT: ethical challenges for medical publishing2023
Challenges and Applications of Large Language Models2023