GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
GPT — это GPT: предварительный взгляд на потенциальное влияние больших языковых моделей на рынок труда
2023-03-17
SCID: 54.1/ujrzasvx
Discuss with AI
Generative Pre-trained Transformers (GPTs)LLM-powered softwarelabor market impactlarge language models (LLMs)occupational task exposure
Figures from the paper
Abstract (AI)
Public estimates of AI’s labor-market exposure typically come from one of two sources: a theoretical judgment about what a model could do, or a record of what people have actually asked it to do. This paper tests whether the second source has a specific, measurable blind spot – that usage-based exposure measures understate AI’s capability for occupations whose tasks have not yet entered common chat usage – using an independently constructed, task-decomposition- based capability judgment, the TRIPS Framework by Trust Insights (which scores individual job tasks for AI suitability), compared directly against Anthropic’s published Economic Index data. Across 434 O*NET-SOC occupations, TRIPS’s coverage share – the estimated share of a job’s tasks current AI can complete independently – correlates strongly with Eloundou et al.’s (2023) capability rating (Spearman’s rho = 0.747), a concordance an independent human- rated column from the same source closely reproduces. Restricted to the 286 occupations where Anthropic’s usage-volume data exists, TRIPS still correlates strongly with Eloundou et al.’s rating (rho = 0.718) but only weakly with Anthropic’s actual usage volume (rho = 0.254): two independently built capability judgments track each other far more closely than either tracks real usage, and both correlations survive a Monte Carlo check simulating realistic classifier label noise. This is directionally consistent with a usage-gating mechanism, corroborated by Anthropic’s own report naming occupations that register zero measured exposure purely for lack of chat traffic – though it cannot, on cross-sectional evidence alone, be distinguished from a slower adoption-lag explanation. Category-level coverage varies substantially (9.4 to 81.7 percent across 22 SOC major groups), supporting neither the claim that any category is immune to AI nor that any nears full automation. We report these findings as directionally consistent and noise-surviving, not confirmed, with construct, sampling, and classification-accuracy limitations detailed throughout.
Key Findings
1
Approximately 19% of U.S. workers may see at least 50% of their tasks impacted by LLMs.
2
Around 80% of the U.S. workforce could have at least 10% of their work tasks affected by the introduction of LLMs.
3
LLM impacts are not confined to industries with recent high productivity growth.
4
LLMs (GPTs) display traits of general-purpose technologies, implying substantial economic, social, and policy implications.
5
Projected LLM impacts span all wage levels, with higher-income jobs potentially facing greater exposure to LLM capabilities and LLM-powered software.
6
When accounting for software and tooling built on top of LLMs, between 47% and 56% of all tasks could be completed significantly faster, amplifying economic impact.
7
With access to an LLM, about 15% of all U.S. worker tasks could be completed significantly faster at the same quality level.
Research Object
Large language models (LLMs) and LLM-powered software as applied to U.S. occupations and workplace tasks
Research Subject
Potential labor-market impacts on U.S. occupations and tasks—share of tasks affected, task-level speed/quality changes, occupational exposure across wage levels, and the scaling effect of LLM-powered software
Publication Details
Publication Date
2023-03-17
Journal
Publisher
ISSN
Cited by
549
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest