A Comprehensive Overview of Large Language Models

Всесторонний обзор больших языковых моделей
Nick M. Barnes, Naveed Akhtar, Ajmal Saeed Mian, Saeed Anwar, Shi Qiu, Humza Naveed, Asad Ullah Khan, Muhammad Saqib, Muhammad Usman
2025-06-18

LLM benchmarkingfine-tuninglarge language modelsmultimodal LLMsnatural language processing
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works encompass diverse topics such as architectural innovations, better training strategies, context length improvements, fine-tuning, multimodal LLMs, robotics, datasets, benchmarking, efficiency, and more. With the rapid development of techniques and regular breakthroughs in LLM research, it has become considerably challenging to perceive the bigger picture of the advances in this direction. Considering the rapidly emerging plethora of literature on LLMs, it is imperative that the research community is able to benefit from a concise yet comprehensive overview of the recent developments in this field. This article provides an overview of the literature on a broad range of LLM-related concepts. Our self-contained comprehensive overview of LLMs discusses relevant background concepts along with covering the advanced topics at the frontier of research in LLMs. This review article is intended to provide not only a systematic survey but also a quick, comprehensive reference for the researchers and practitioners to draw insights from extensive, informative summaries of the existing works to advance the LLM research.
1
It systematically covers LLM architectures, training strategies, context-length improvements, fine-tuning, multimodal models, robotics, datasets, benchmarking, and efficiency.
2
The article provides a self-contained, comprehensive overview of large language model research and its recent developments.
3
The review combines foundational background with advanced frontier topics, offering a concise reference for researchers and practitioners.
4
The survey addresses the challenge of understanding rapidly expanding and diverse LLM literature by organizing extensive existing research into informative summaries.

Large Language Models (LLMs)

Recent developments and research concepts spanning LLM architectures, training, context length, fine-tuning, multimodality, robotics, datasets, benchmarking, and efficiency

Publication Details
Publication Date
2025-06-18
Journal
Publisher
ISSN
Cited by
2815
Access Type
Author Information
Authors
Nick M. Barnes
Naveed Akhtar
Ajmal Saeed Mian
Saeed Anwar
Shi Qiu
Humza Naveed
Asad Ullah Khan
Muhammad Saqib
Muhammad Usman
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%