Will ChatGPT get you caught? Rethinking of Plagiarism Detection
Поймает ли вас ChatGPT? Переосмысление выявления плагиата
2023-02-08
SCID: 54.1/66hqkyws
Discuss with AI
AI-generated essaysChatGPTacademic integrityeducationplagiarism detection
Figures from the paper
Abstract (AI)
The rise of Artificial Intelligence (AI) technology and its impact on education has been a topic of growing concern in recent years. The new generation AI systems such as chatbots have become more accessible on the Internet and stronger in terms of capabilities. The use of chatbots, particularly ChatGPT, for generating academic essays at schools and colleges has sparked fears among scholars. This study aims to explore the originality of contents produced by one of the most popular AI chatbots, ChatGPT. To this end, two popular plagiarism detection tools were used to evaluate the originality of 50 essays generated by ChatGPT on various topics. Our results manifest that ChatGPT has a great po-tential to generate sophisticated text outputs without being well caught by the plagiarism check software. In other words, ChatGPT can create content on many topics with high originality as if they were written by someone. These findings align with the recent concerns about students using chatbots for an easy shortcut to success with minimal or no effort. Moreover, ChatGPT was asked to verify if the essays were generated by itself, as an additional measure of plagiarism check, and it showed superior performance compared to the tradi-tional plagiarism-detection tools. The paper discusses the need for institutions to consider appropriate measures to mitigate potential plagiarism issues and advise on the ongoing debate surrounding the impact of AI technology on education. Further implications are discussed in the paper.
Key Findings
1
ChatGPT produced sophisticated essays that plagiarism checkers often failed to identify as non-original or AI-generated.
2
ChatGPT’s self-verification of whether it generated the essays reportedly performed better than the traditional plagiarism-detection tools.
3
The essays received high originality indications, appearing comparable to work written by humans despite being generated by ChatGPT.
4
The findings highlight the need for educational institutions to develop measures addressing AI-assisted plagiarism and its effects on education.
5
Two popular plagiarism-detection tools evaluated 50 ChatGPT-generated essays across various topics.
Research Object
academic essays generated by ChatGPT
Research Subject
the originality of ChatGPT-generated essays and their detectability by plagiarism-detection tools
Publication Details
Publication Date
2023-02-08
Journal
Publisher
ISSN
Cited by
259
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
Cited by4
ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope2023
Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings2023
A survey on large language model (LLM) security and privacy: The Good, The Bad, and The Ugly2024
War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education2023