A SYSTEMATIC LITERATURE REVIEW: RECURSIVE FEATURE ELIMINATION ALGORITHMS
Систематический обзор литературы: алгоритмы рекурсивного удаления признаков
2024-02-01
SCID: 54.1/bahwbz3g
Discuss with AI
RFEfeature selection (filter and embedded)modified RFErecursive feature eliminationstrategy RFE
Figures from the paper
Abstract (AI)
Recursive feature elimination (RFE) is a feature selection algorithm that works by gradually eliminating unimportant features. RFE has become a popular method for feature selection in various machine learning applications, such as classification and prediction. However, there is no systematic literature review (SLR) that discusses recursive feature elimination algorithms. This article conducts a SLR on RFE algorithms. The goal is to provide an overview of the current state of the RFE algorithm. This SLR uses IEEE Xplore, ScienceDirect, Springer, and Scopus (publish and publish) databases from 2018 to 2023. This SLR received 76 relevant papers with 49% standard RFEs, 43% strategy RFEs, and 8% modified RFEs. Research using RFE continues to increase every year, from 2018 to 2023. The feature selection method used simultaneously or for comparison is based on a filter approach, namely Pearson correlation, and an embedded approach, namely random forest. The most widely used machine learning algorithms are support vector machines and random forests, with 19.5% and 16.7%, respectively. Strategy RFE and modified RFE can be referred to as hybrid RFEs. Based on relevant papers, it is found that the RFE strategy is broadly divided into two categories: using RFE after other feature selection methods and using RFE simultaneously with other methods. Modification of the RFE is done by modifying the flow of the RFE. The modification process is divided into two categories: before the process of calculating the smallest weight criteria and after calculating the smallest weight criteria. Calculating the smallest weight criteria in this RFE modification is still a challenge at this time to obtain optimal results.
Key Findings
1
A systematic literature review (2018–2023) identified 76 relevant papers on recursive feature elimination (RFE).
2
Among reviewed papers, 49% used standard RFE, 43% used strategy RFE, and 8% used modified RFE.
3
Calculating the smallest-weight criterion in modified RFE remains a current challenge for achieving optimal results.
4
Common comparative or concurrent feature selection methods were filter approaches (Pearson correlation) and embedded approaches (random forest).
5
RFE modifications alter RFE workflow and are categorized by whether changes occur before or after calculating the smallest-weight criterion.
6
RFE strategy variants split into two groups: applying RFE after other feature selection methods and applying RFE simultaneously with other methods.
7
Research using RFE increased each year from 2018 to 2023.
8
Strategy RFE and modified RFE are characterized as hybrid RFEs in the literature.
9
The most widely used ML algorithms with RFE were support vector machines (19.5%) and random forests (16.7%).
Research Object
Recursive feature elimination (RFE) algorithms
Research Subject
State, taxonomies, strategies, modifications, usage patterns, and evaluation of RFE algorithms in machine learning (including categories: standard, strategy/hybrid, modified RFE; integration with filter/embedded methods; common paired classifiers and challenges in weight-criterion calculation)
Publication Details
Publication Date
2024-02-01
Journal
Publisher
ISSN
Cited by
92
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest