Artificial intelligence for literature reviews: opportunities and challenges
Искусственный интеллект для обзоров литературы: возможности и проблемы
2024-08-17
SCID: 54.1/n6mqyu9d
Discuss with AI
AI-enhanced SLR toolsknowledge graphslarge language modelsstandardised evaluation frameworksystematic literature reviews
Figures from the paper
Abstract (AI)
Abstract This paper presents a comprehensive review of the use of Artificial Intelligence (AI) in Systematic Literature Reviews (SLRs). A SLR is a rigorous and organised methodology that assesses and integrates prior research on a given topic. Numerous tools have been developed to assist and partially automate the SLR process. The increasing role of AI in this field shows great potential in providing more effective support for researchers, moving towards the semi-automatic creation of literature reviews. Our study focuses on how AI techniques are applied in the semi-automation of SLRs, specifically in the screening and extraction phases. We examine 21 leading SLR tools using a framework that combines 23 traditional features with 11 AI features. We also analyse 11 recent tools that leverage large language models for searching the literature and assisting academic writing. Finally, the paper discusses current trends in the field, outlines key research challenges, and suggests directions for future research. We highlight three primary research challenges: integrating advanced AI solutions, such as large language models and knowledge graphs, improving usability, and developing a standardised evaluation framework. We also propose best practices to ensure more robust evaluations in terms of performance, usability, and transparency. Overall, this review offers a detailed overview of AI-enhanced SLR tools for researchers and practitioners, providing a foundation for the development of next-generation AI solutions in this field.
Key Findings
1
AI is increasingly enabling semi-automation of systematic literature reviews, particularly during study screening and data-extraction phases.
2
An additional analysis examines 11 recent tools using large language models for literature searching and academic-writing assistance.
3
The field’s primary challenges are integrating advanced AI methods such as large language models and knowledge graphs, improving usability, and standardizing evaluation.
4
The paper proposes evaluation best practices emphasizing performance, usability, and transparency to support robust development of next-generation AI-enhanced review tools.
5
The review evaluates 21 leading systematic literature review tools using a framework combining 23 traditional features and 11 AI-specific features.
Research Object
AI-enhanced tools and techniques for semi-automating systematic literature reviews (SLRs)
Research Subject
Their application, capabilities, usability, performance, transparency, and challenges in supporting the screening, extraction, literature-search, and academic-writing phases of SLRs
Publication Details
Publication Date
2024-08-17
Journal
Publisher
ISSN
Cited by
240
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai7
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement2009
Meta-analysis of Observational Studies in Epidemiology A Proposal for Reporting2000
Can we open the black box of AI?2016
Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey2023
Generative AI at Work2023
Knowledge Graphs: Opportunities and Challenges2023
Open Research Knowledge Graph2019
Cited by3
The Rise of Agentic AI: A Review of Definitions, Frameworks, Architectures, Applications, Evaluation Metrics, and Challenges2025
Cybersecurity in Radio Frequency Technologies: A Scientometric and Systematic Review with Implications for IoT and Wireless Applications2026
Research hypothesis generation over scientific knowledge graphs2025