GPT-3: Its Nature, Scope, Limits, and Consequences
GPT-3: его природа, масштабы, ограничения и последствия
2020-01-01
SCID: 54.1/94zghgbg
Discuss with AI
GPT-3Turing Testautoregressive language modelethical questionsreversible and irreversible questions
Figures from the paper
Abstract (AI)
Abstract In this commentary, we discuss the nature of reversible and irreversible questions, that is, questions that may enable one to identify the nature of the source of their answers. We then introduce GPT-3, a third-generation, autoregressive language model that uses deep learning to produce human-like texts, and use the previous distinction to analyse it. We expand the analysis to present three tests based on mathematical, semantic (that is, the Turing Test), and ethical questions and show that GPT-3 is not designed to pass any of them. This is a reminder that GPT-3 does not do what it is not supposed to do, and that any interpretation of GPT-3 as the beginning of the emergence of a general form of artificial intelligence is merely uninformed science fiction. We conclude by outlining some of the significant consequences of the industrialisation of automatic and cheap production of good, semantic artefacts.
Key Findings
1
Analyzes GPT-3 using reversible/irreversible distinction and three tests: mathematical, semantic (Turing Test), and ethical.
2
Argues that interpreting GPT-3 as the emergence of general artificial intelligence is unfounded speculative fiction.
3
Finds GPT-3 is not designed to pass the mathematical, semantic (Turing), or ethical tests presented.
4
Highlights significant consequences of industrialised, cheap automatic production of semantic artefacts.
5
Introduces distinction between reversible and irreversible questions for identifying answer sources.
6
Presents GPT-3 as a third-generation autoregressive language model producing human-like text via deep learning.
Research Object
GPT-3 (third-generation autoregressive language model)
Research Subject
Assessment of GPT-3's capabilities and limits via analysis of reversible vs irreversible questions and three tests (mathematical, semantic/Turing, and ethical) and implications of industrialized automated production of semantic artifacts
Publication Details
Publication Date
2020-01-01
Journal
Publisher
ISSN
Cited by
2728
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
Cited by20
Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy2023
A Survey on Evaluation of Large Language Models2024
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT2023
ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope2023
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?2023
ChatGPT for Education and Research: Opportunities, Threats, and Strategies2023
ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing2023
Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios2023
A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges2024
A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage2023
GPT (Generative Pre-Trained Transformer)— A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions2024
The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming2022
Generative artificial intelligence in supply chain and operations management: a capability-based framework for analysis and implementation2024
Generative artificial intelligence in innovation management: A preview of future research developments2024
Generative AI and ChatGPT in School Children’s Education: Evidence from a School Lesson2023
AI literacy and its implications for prompt engineering strategies2024
Human and AI Ensembles: When Can They Work?2021
Investigating the Use of ChatGPT for the Scheduling of Construction Projects2023
Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects2023
The impact of large language models on higher education: exploring the connection between AI and Education 4.02024