ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?

ChatGPT: генератор бессмыслицы или конец традиционного оценивания в высшем образовании?
Jürgen Rudolph, Shannon Tan, Samson Tan
2023-01-25

AI chatbotsChatGPTartificial intelligence in educationgenerative pretrained transformerhigher education assessment
ChatGPT is the world’s most advanced chatbot thus far. Unlike other chatbots, it can create impressive prose within seconds, and it has created much hype and doomsday predictions when it comes to student assessment in higher education and a host of other matters. ChatGPT is a state-of-the-art language model (a variant of OpenAI’s Generative Pretrained Transformer (GPT) language model) designed to generate text that can be indistinguishable from text written by humans. It can engage in conversation with users in a seemingly natural and intuitive way. In this article, we briefly tell the story of OpenAI, the organisation behind ChatGPT. We highlight the fundamental change from a not-for-profit organisation to a commercial business model. In terms of our methods, we conducted an extensive literature review and experimented with this artificial intelligence (AI) software. Our literature review shows our review to be amongst the first peer-reviewed academic journal articles to explore ChatGPT and its relevance for higher education (especially assessment, learning and teaching). After a description of ChatGPT’s functionality and a summary of its strengths and limitations, we focus on the technology’s implications for higher education and discuss what is the future of learning, teaching and assessment in higher education in the context of AI chatbots such as ChatGPT. We position ChatGPT in the context of current Artificial Intelligence in Education (AIEd) research, discuss student-facing, teacher-facing and system-facing applications, and analyse opportunities and threats. We conclude the article with recommendations for students, teachers and higher education institutions. Many of them focus on assessment.
1
ChatGPT generates fluent, human-like prose within seconds and can sustain seemingly natural, intuitive conversations.
2
ChatGPT’s capabilities challenge traditional assessment practices and motivate recommendations for students, educators, and institutions, many focused on assessment reform.
3
The article is among the first peer-reviewed journal studies examining ChatGPT’s implications for higher education, particularly assessment, learning, and teaching.
4
The article situates ChatGPT within Artificial Intelligence in Education research and summarizes its functionality, strengths, limitations, and implications for future higher-education practices.
5
The authors identify both opportunities and threats from ChatGPT across student-facing, teacher-facing, and system-facing applications in higher education.

ChatGPT as an AI chatbot and state-of-the-art language model applied in higher education

Its functionality, strengths, limitations, and implications for learning, teaching, and especially student assessment

Publication Details
Publication Date
2023-01-25
Journal
Publisher
ISSN
Cited by
1768
Access Type
Author Information
Authors
Jürgen Rudolph
Shannon Tan
Samson Tan
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%