Artificial intelligence for literature reviews: opportunities and challenges

Искусственный интеллект для обзоров литературы: возможности и проблемы
Francesco Osborne, Enrico Motta, Angelo A. Salatino, Francisco Bolaños
2024-08-17

AI-enhanced SLR toolsknowledge graphslarge language modelsstandardised evaluation frameworksystematic literature reviews
Abstract This paper presents a comprehensive review of the use of Artificial Intelligence (AI) in Systematic Literature Reviews (SLRs). A SLR is a rigorous and organised methodology that assesses and integrates prior research on a given topic. Numerous tools have been developed to assist and partially automate the SLR process. The increasing role of AI in this field shows great potential in providing more effective support for researchers, moving towards the semi-automatic creation of literature reviews. Our study focuses on how AI techniques are applied in the semi-automation of SLRs, specifically in the screening and extraction phases. We examine 21 leading SLR tools using a framework that combines 23 traditional features with 11 AI features. We also analyse 11 recent tools that leverage large language models for searching the literature and assisting academic writing. Finally, the paper discusses current trends in the field, outlines key research challenges, and suggests directions for future research. We highlight three primary research challenges: integrating advanced AI solutions, such as large language models and knowledge graphs, improving usability, and developing a standardised evaluation framework. We also propose best practices to ensure more robust evaluations in terms of performance, usability, and transparency. Overall, this review offers a detailed overview of AI-enhanced SLR tools for researchers and practitioners, providing a foundation for the development of next-generation AI solutions in this field.
1
AI is increasingly enabling semi-automation of systematic literature reviews, particularly during study screening and data-extraction phases.
2
An additional analysis examines 11 recent tools using large language models for literature searching and academic-writing assistance.
3
The field’s primary challenges are integrating advanced AI methods such as large language models and knowledge graphs, improving usability, and standardizing evaluation.
4
The paper proposes evaluation best practices emphasizing performance, usability, and transparency to support robust development of next-generation AI-enhanced review tools.
5
The review evaluates 21 leading systematic literature review tools using a framework combining 23 traditional features and 11 AI-specific features.

AI-enhanced tools and techniques for semi-automating systematic literature reviews (SLRs)

Their application, capabilities, usability, performance, transparency, and challenges in supporting the screening, extraction, literature-search, and academic-writing phases of SLRs

Publication Details
Publication Date
2024-08-17
Journal
Publisher
ISSN
Cited by
240
Access Type
Author Information
Authors
Francesco Osborne
Enrico Motta
Angelo A. Salatino
Francisco Bolaños
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%