Domain adaptation of large language models for geotechnical applications
Адаптация больших языковых моделей к задачам геотехники
2026-01-08
SCID: 54.1/fddts33g
Discuss with AI
domain adaptationfine-tuninggeotechnical engineeringlarge language modelsretrieval-augmented generation
Figures from the paper
Abstract (AI)
The rapid advancement of large language models (LLMs) is transforming opportunities in geotechnical engineering, where workflows rely on complex, text-rich data. While general-purpose LLMs demonstrate strong reasoning capabilities, their effectiveness in geotechnical applications is constrained by limited exposure to specialized terminology and domain logic. Thus, domain adaptation, tailoring general LLMs for geotechnical use, has become essential. This paper presents the first review of LLM adaptation and application in geotechnical contexts. It critically examines four key adaptation strategies, including prompt engineering, retrieval-augmented generation, domain-adaptive pretraining, and fine-tuning, and evaluates their comparative benefits, limitations, and implementation trends. This review synthesizes current applications spanning geological interpretation, subsurface characterization, design analysis, numerical modeling, risk assessment, and geotechnical education. Findings show that domain-adapted LLMs substantially improve reasoning accuracy, automation, and interpretability, yet remain limited by data scarcity, validation challenges, and explainability concerns. Future research directions are also suggested. This review establishes a critical foundation for developing geotechnically literate LLMs and guides researchers and practitioners in advancing the digital transformation of geotechnical engineering.
Key Findings
1
Current geotechnical LLM applications remain constrained by specialized-data scarcity, validation difficulties, and explainability concerns.
2
Domain-adapted LLMs improve reasoning accuracy, workflow automation, and interpretability across geological interpretation, subsurface characterization, design, modeling, risk assessment, and education.
3
It critically compares four adaptation strategies: prompt engineering, retrieval-augmented generation, domain-adaptive pretraining, and fine-tuning.
4
The review identifies research directions for developing geotechnically literate LLMs and supporting digital transformation in geotechnical engineering.
5
This paper provides the first review of large language model adaptation and applications specifically in geotechnical engineering.
Research Object
large language models adapted for geotechnical engineering applications
Research Subject
adaptation strategies, applications, benefits, limitations, and implementation trends of LLMs in geotechnical contexts
Publication Details
Publication Date
2026-01-08
Journal
Publisher
ISSN
Cited by
3
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest