Concept Drift Detection in Data Stream Mining : A literature review

Обнаружение дрейфа концепций при анализе потоков данных: обзор литературы
Supriya Agrahari, Anil Kumar Singh
2021-12-03

adaptive mechanismsconcept drift detectiondata stream miningnon-stationary dataonline learning
In recent years, the availability of time series streaming information has been growing enormously. Learning from real-time data has been receiving increasingly more attention since the last decade. Online learning encounters the change in the distribution of data while extracting considerable information from data streams. Hidden data contexts, which are not known to the learning algorithms, are known as concept drift. Classifier classifies incoming instances using past training instances of the data stream. The accuracy of the classifier deteriorates because of the concept drift. The traditional classifiers are not expected to learn the patterns in a non-stationary distribution of data. For any real-time use, the classifier needs to detect the concept drift and adapts over time. In the real-time scenario, we have to deal with semi-supervised and unsupervised data, which provide no or fewer labeled data. The motivation behind this paper is to introduce a survey identified with a broad categorization of concept drift detectors with their key points, limitations, and advantages. Eventually, the article suggests research trends, research challenges, and future work. The adaptive mechanisms are also incorporated in this survey.
1
Concept drift represents hidden changes in streaming data distributions that cause traditional classifiers’ accuracy to deteriorate over time.
2
Effective real-time stream mining requires detectors that identify distributional changes and adaptive mechanisms that update models accordingly.
3
The article identifies research trends, open challenges, and future directions for concept drift detection and adaptation.
4
The review broadly categorizes concept drift detection methods and summarizes their key characteristics, advantages, and limitations.
5
The survey emphasizes the challenge of detecting drift in semi-supervised and unsupervised streams with limited or unavailable labels.

concept drift in data streams

detection and adaptive handling of concept drift, including detector categories, limitations, advantages, and adaptation mechanisms

Publication Details
Publication Date
2021-12-03
Journal
Publisher
ISSN
Cited by
229
Access Type
Author Information
Authors
Supriya Agrahari
Anil Kumar Singh
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%