The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes
Периодическая таблица рассуждений больших языковых моделей: структурированный обзор парадигм, методов и режимов отказа
2026-06-09
SCID: 54.1/hejyc3vk
Discuss with AI
Chain-of-ThoughtLLM reasoningmulti-hop question answeringretrieval-augmented reasoningverifier-guided inference
Figures from the paper
Abstract (AI)
Reasoning has become central to how Large Language Models (LLMs) are evaluated and interpreted, spanning Chain-of-Thought (CoT), mathematical problem-solving, multi-hop question answering, code generation, retrieval-augmented reasoning, tool use, and multimodal decision-making. In this survey, we introduce the Periodic Table of LLM Reasoning, a framework organizing 300+ recent papers by reasoning paradigm, methodological mechanism, evaluation setting, and failure mode. We classify LLM reasoning into nine paradigms: Chain-of-Thought, Multi-Hop, Mathematical, Commonsense, Visual and Temporal, Code and Algorithmic, Retrieval-Augmented, Tool-Augmented or Agentic, and Reinforcement Learning-based reasoning. For each, we review approaches, including prompting, architectural interventions, supervised fine-tuning, verifier-guided inference, reward modeling, retrieval, tool interfaces, agentic workflows, and benchmark design. We argue that LLM reasoning is not a single emergent capability but a family of scaffolded behaviors shaped by model scale, task structure, external memory, supervision, and evaluation protocols. We synthesize recurring failure modes, including hallucinated reasoning, brittle multi-step inference, spurious rationales, weak causal grounding, poor out-of-distribution generalization, benchmark contamination, and unreliable self-verification. Progress is difficult to compare across paradigms because gains may arise from prompting, retrieval, verifier design, or benchmark structure rather than general reasoning ability. The survey connects methods to their assumptions, strengths, and failure modes, providing a reference map of the field and a diagnostic framework for future work. We conclude that robust LLM reasoning will require meta-reasoning, multimodal and temporal grounding, adaptive tool use, and principled evaluation under distribution shift.
Key Findings
1
Across paradigms, recurring failures include hallucinated reasoning, brittle multi-step inference, spurious rationales, weak causal grounding, poor out-of-distribution generalization, contamination, and unreliable self-verification.
2
Comparisons of reasoning progress are confounded because improvements may result from prompting, retrieval, verifier design, or benchmark structure rather than general reasoning ability.
3
It argues that LLM reasoning is a family of scaffolded behaviors shaped by model scale, task structure, external memory, supervision, and evaluation protocols.
4
The survey identifies meta-reasoning, multimodal and temporal grounding, adaptive tool use, and principled distribution-shift evaluation as requirements for robust LLM reasoning.
5
The survey organizes 300+ studies into a structured framework covering nine LLM reasoning paradigms, methods, evaluation settings, and failure modes.
Research Object
Large Language Model (LLM) reasoning
Research Subject
reasoning paradigms, methodological mechanisms, evaluation settings, and recurring failure modes of LLMs
Publication Details
Publication Date
2026-06-09
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest