Artificial Hallucinations in ChatGPT: Implications in Scientific Writing
Искусственные галлюцинации в ChatGPT: значение для научной публикации
2023-02-19
SCID: 54.1/qun29s2k
Discuss with AI
ChatGPTartificial hallucinationshomocystinuria-associated osteoporosislate-onset Pompe diseasescientific writing
Figures from the paper
Abstract (AI)
While still in its infancy, ChatGPT (Generative Pretrained Transformer), introduced in November 2022, is bound to hugely impact many industries, including healthcare, medical education, biomedical research, and scientific writing. Implications of ChatGPT, that new chatbot introduced by OpenAI on academic writing, is largely unknown. In response to the Journal of Medical Science (Cureus) Turing Test - call for case reports written with the assistance of ChatGPT, we present two cases one of homocystinuria-associated osteoporosis, and the other is on late-onset Pompe disease (LOPD), a rare metabolic disorder. We tested ChatGPT to write about the pathogenesis of these conditions. We documented the positive, negative, and rather troubling aspects of our newly introduced chatbot's performance.
Key Findings
1
ChatGPT was tested specifically on generating descriptions of the pathogenesis of these two medical conditions.
2
The authors document both beneficial and negative aspects of ChatGPT’s performance in biomedical writing.
3
The paper evaluates ChatGPT-assisted scientific writing through two case reports on homocystinuria-associated osteoporosis and late-onset Pompe disease.
4
The paper highlights troubling aspects of ChatGPT-generated scientific content, underscoring potential risks for academic and medical writing.
5
The study provides an early assessment of ChatGPT’s implications for healthcare, biomedical research, medical education, and scientific writing.
Research Object
ChatGPT-assisted scientific writing about the pathogenesis of homocystinuria-associated osteoporosis and late-onset Pompe disease
Research Subject
ChatGPT’s performance, including its positive, negative, and artificial-hallucination aspects, in generating disease-pathogenesis content
Publication Details
Publication Date
2023-02-19
Journal
Publisher
ISSN
Cited by
1540
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai3
Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models2023
Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers2023
Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers2022
Cited by9
ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope2023
Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education2024
Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings2023
The role of ChatGPT in higher education: Benefits, challenges, and future research directions2023
Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say?2023
A comprehensive survey of ChatGPT: Advancements, applications, prospects, and challenges2023
Generative AI Literacy: Twelve Defining Competencies2024
Conversational and generative artificial intelligence and human–chatbot interaction in education and research2024
Promoting Critical Thinking in Biological Sciences in the Era of Artificial Intelligence: The Role of Higher Education2025