A Comprehensive Overview of Large Language Models
Всесторонний обзор больших языковых моделей
2025-06-18
SCID: 54.1/cgpzd23n
Discuss with AI
LLM benchmarkingfine-tuninglarge language modelsmultimodal LLMsnatural language processing
Figures from the paper
Abstract (AI)
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works encompass diverse topics such as architectural innovations, better training strategies, context length improvements, fine-tuning, multimodal LLMs, robotics, datasets, benchmarking, efficiency, and more. With the rapid development of techniques and regular breakthroughs in LLM research, it has become considerably challenging to perceive the bigger picture of the advances in this direction. Considering the rapidly emerging plethora of literature on LLMs, it is imperative that the research community is able to benefit from a concise yet comprehensive overview of the recent developments in this field. This article provides an overview of the literature on a broad range of LLM-related concepts. Our self-contained comprehensive overview of LLMs discusses relevant background concepts along with covering the advanced topics at the frontier of research in LLMs. This review article is intended to provide not only a systematic survey but also a quick, comprehensive reference for the researchers and practitioners to draw insights from extensive, informative summaries of the existing works to advance the LLM research.
Key Findings
1
It systematically covers LLM architectures, training strategies, context-length improvements, fine-tuning, multimodal models, robotics, datasets, benchmarking, and efficiency.
2
The article provides a self-contained, comprehensive overview of large language model research and its recent developments.
3
The review combines foundational background with advanced frontier topics, offering a concise reference for researchers and practitioners.
4
The survey addresses the challenge of understanding rapidly expanding and diverse LLM literature by organizing extensive existing research into informative summaries.
Research Object
Large Language Models (LLMs)
Research Subject
Recent developments and research concepts spanning LLM architectures, training, context length, fine-tuning, multimodality, robotics, datasets, benchmarking, and efficiency
Publication Details
Publication Date
2025-06-18
Journal
Publisher
ISSN
Cited by
2815
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai20
PyTorch: An Imperative Style, High-Performance Deep Learning Library2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019
LLaMA: Open and Efficient Foundation Language Models2023
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale2020
Transformers: State-of-the-Art Natural Language Processing2020
A Survey of Large Language Models2026
Training language models to follow instructions with human feedback2022
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context2019
A survey on large language model based autonomous agents2024
PaLM: Scaling Language Modeling with Pathways2022
BloombergGPT: A Large Language Model for Finance2023
GPT-4 Technical Report2023
🧜Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models2025
Scaling Laws for Neural Language Models2020
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing2021
Flamingo: a Visual Language Model for Few-Shot Learning2022
Evaluating Large Language Models Trained on Code2021
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey2023
Autonomous chemical research with large language models2023
Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models2023
Cited by11
A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and Challenges2024
MM-LLMs: Recent Advances in MultiModal Large Language Models2024
Rag-Fusion: A New Take on Retrieval Augmented Generation2024
Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects2023
Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges2026
Large Language Models: A Structured Taxonomy and Review of Challenges, Limitations, Solutions, and Future Directions2025
A guide to prompt design: foundations and applications for healthcare simulationists2025
LLM-Commentator: Novel fine-tuning strategies of large language models for automatic commentary generation using football event data2024
Benchmark Evaluations, Applications, and Challenges of Large Vision Language Models: A Survey2025
Trust behavior in AI emerges from distrust in humans: A machine learning study on decision-making guidance2026
LLM-Enabled Multi-Agent Systems: Empirical Evaluation and Insights into Emerging Design Patterns & Paradigms2026