GPT-3: Its Nature, Scope, Limits, and Consequences
GPT-3: его природа, масштабы, ограничения и последствия
2020-11-01
SCID: 54.1/94zghgbg
Discuss with AI
GPT-3Turing Testautoregressive language modelethical questionsreversible and irreversible questions
Figures from the paper
Abstract (AI)
Abstract In this commentary, we discuss the nature of reversible and irreversible questions, that is, questions that may enable one to identify the nature of the source of their answers. We then introduce GPT-3, a third-generation, autoregressive language model that uses deep learning to produce human-like texts, and use the previous distinction to analyse it. We expand the analysis to present three tests based on mathematical, semantic (that is, the Turing Test), and ethical questions and show that GPT-3 is not designed to pass any of them. This is a reminder that GPT-3 does not do what it is not supposed to do, and that any interpretation of GPT-3 as the beginning of the emergence of a general form of artificial intelligence is merely uninformed science fiction. We conclude by outlining some of the significant consequences of the industrialisation of automatic and cheap production of good, semantic artefacts.
Key Findings
1
Analyzes GPT-3 using reversible/irreversible distinction and three tests: mathematical, semantic (Turing Test), and ethical.
2
Argues that interpreting GPT-3 as the emergence of general artificial intelligence is unfounded speculative fiction.
3
Finds GPT-3 is not designed to pass the mathematical, semantic (Turing), or ethical tests presented.
4
Highlights significant consequences of industrialised, cheap automatic production of semantic artefacts.
5
Introduces distinction between reversible and irreversible questions for identifying answer sources.
6
Presents GPT-3 as a third-generation autoregressive language model producing human-like text via deep learning.
Research Object
GPT-3 (third-generation autoregressive language model)
Research Subject
Assessment of GPT-3's capabilities and limits via analysis of reversible vs irreversible questions and three tests (mathematical, semantic/Turing, and ethical) and implications of industrialized automated production of semantic artifacts
Publication Details
Publication Date
2020-11-01
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest