Concept Drift Detection in Data Stream Mining : A literature review
Обнаружение дрейфа концепций при анализе потоков данных: обзор литературы
2021-12-03
SCID: 54.1/p4xbcrec
Discuss with AI
adaptive mechanismsconcept drift detectiondata stream miningnon-stationary dataonline learning
Figures from the paper
Abstract (AI)
In recent years, the availability of time series streaming information has been growing enormously. Learning from real-time data has been receiving increasingly more attention since the last decade. Online learning encounters the change in the distribution of data while extracting considerable information from data streams. Hidden data contexts, which are not known to the learning algorithms, are known as concept drift. Classifier classifies incoming instances using past training instances of the data stream. The accuracy of the classifier deteriorates because of the concept drift. The traditional classifiers are not expected to learn the patterns in a non-stationary distribution of data. For any real-time use, the classifier needs to detect the concept drift and adapts over time. In the real-time scenario, we have to deal with semi-supervised and unsupervised data, which provide no or fewer labeled data. The motivation behind this paper is to introduce a survey identified with a broad categorization of concept drift detectors with their key points, limitations, and advantages. Eventually, the article suggests research trends, research challenges, and future work. The adaptive mechanisms are also incorporated in this survey.
Key Findings
1
Concept drift represents hidden changes in streaming data distributions that cause traditional classifiers’ accuracy to deteriorate over time.
2
Effective real-time stream mining requires detectors that identify distributional changes and adaptive mechanisms that update models accordingly.
3
The article identifies research trends, open challenges, and future directions for concept drift detection and adaptation.
4
The review broadly categorizes concept drift detection methods and summarizes their key characteristics, advantages, and limitations.
5
The survey emphasizes the challenge of detecting drift in semi-supervised and unsupervised streams with limited or unavailable labels.
Research Object
concept drift in data streams
Research Subject
detection and adaptive handling of concept drift, including detector categories, limitations, advantages, and adaptation mechanisms
Publication Details
Publication Date
2021-12-03
Journal
Publisher
ISSN
Cited by
229
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest