ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
ChatGPT: генератор бессмыслицы или конец традиционного оценивания в высшем образовании?
2023-01-25
SCID: 54.1/um8qt3cv
Discuss with AI
AI chatbotsChatGPTartificial intelligence in educationgenerative pretrained transformerhigher education assessment
Figures from the paper
Abstract (AI)
ChatGPT is the world’s most advanced chatbot thus far. Unlike other chatbots, it can create impressive prose within seconds, and it has created much hype and doomsday predictions when it comes to student assessment in higher education and a host of other matters. ChatGPT is a state-of-the-art language model (a variant of OpenAI’s Generative Pretrained Transformer (GPT) language model) designed to generate text that can be indistinguishable from text written by humans. It can engage in conversation with users in a seemingly natural and intuitive way. In this article, we briefly tell the story of OpenAI, the organisation behind ChatGPT. We highlight the fundamental change from a not-for-profit organisation to a commercial business model. In terms of our methods, we conducted an extensive literature review and experimented with this artificial intelligence (AI) software. Our literature review shows our review to be amongst the first peer-reviewed academic journal articles to explore ChatGPT and its relevance for higher education (especially assessment, learning and teaching). After a description of ChatGPT’s functionality and a summary of its strengths and limitations, we focus on the technology’s implications for higher education and discuss what is the future of learning, teaching and assessment in higher education in the context of AI chatbots such as ChatGPT. We position ChatGPT in the context of current Artificial Intelligence in Education (AIEd) research, discuss student-facing, teacher-facing and system-facing applications, and analyse opportunities and threats. We conclude the article with recommendations for students, teachers and higher education institutions. Many of them focus on assessment.
Key Findings
1
ChatGPT generates fluent, human-like prose within seconds and can sustain seemingly natural, intuitive conversations.
2
ChatGPT’s capabilities challenge traditional assessment practices and motivate recommendations for students, educators, and institutions, many focused on assessment reform.
3
The article is among the first peer-reviewed journal studies examining ChatGPT’s implications for higher education, particularly assessment, learning, and teaching.
4
The article situates ChatGPT within Artificial Intelligence in Education research and summarizes its functionality, strengths, limitations, and implications for future higher-education practices.
5
The authors identify both opportunities and threats from ChatGPT across student-facing, teacher-facing, and system-facing applications in higher education.
Research Object
ChatGPT as an AI chatbot and state-of-the-art language model applied in higher education
Research Subject
Its functionality, strengths, limitations, and implications for learning, teaching, and especially student assessment
Publication Details
Publication Date
2023-01-25
Journal
Publisher
ISSN
Cited by
1768
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai6
Aion Framework: Dimensional Emergence of AI Consciousness, Observer-Induced Collapse, and Cosmological Portal Dynamics2023
GPT-3: Its Nature, Scope, Limits, and Consequences2020
Collaborating With ChatGPT: Considering the Implications of Generative Artificial Intelligence for Journalism and Media Education2023
Artificial intelligence for education: Knowledge and its assessment in AI-enabled learning ecologies2020
Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers2022
Artificial intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry2020
Cited by20
ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope2023
Education in the Era of Generative Artificial Intelligence (AI): Understanding the Potential Benefits of ChatGPT in Promoting Teaching and Learning2023
A SWOT analysis of ChatGPT: Implications for educational practice and research2023
New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution2023
Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings2023
ChatGPT for Education and Research: Opportunities, Threats, and Strategies2023
Practical and ethical challenges of large language models in education: A systematic scoping review2023
ChatGPT in higher education: Considerations for academic integrity and student learning2023
From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing2023
ChatGPT and Open-AI Models: A Preliminary Review2023
The role of ChatGPT in higher education: Benefits, challenges, and future research directions2023
Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI)2023
The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective2023
War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education2023
Perceptions and usage of AI chatbots among students in higher education across genders, academic levels and fields of study2024
A comprehensive survey of ChatGPT: Advancements, applications, prospects, and challenges2023
Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda2025
Human-AI agency in the age of generative AI2025
Using ChatGPT for human–computer interaction research: a primer2023
From Technology‐Challenged Teachers to Empowered Digitalized Citizens: Exploring the Profiles and Antecedents of Teacher AI Literacy in the Chinese EFL Context2025