DeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series

DeepAnT: Подход на основе глубокого обучения для неконтролируемого обнаружения аномалий во временных рядах
Andreas Dengel, Sheraz Ahmed, Mohsin Munir, Shoaib Ahmed Siddiqui
2018-12-19

deep convolutional neural networkpoint and contextual anomaliesstreaming sensor datatime series forecastingunsupervised anomaly detection
Traditional distance and density-based anomaly detection techniques are unable to detect periodic and seasonality related point anomalies which occur commonly in streaming data, leaving a big gap in time series anomaly detection in the current era of the IoT. To address this problem, we present a novel deep learning-based anomaly detection approach (DeepAnT) for time series data, which is equally applicable to the non-streaming cases. DeepAnT is capable of detecting a wide range of anomalies, i.e., point anomalies, contextual anomalies, and discords in time series data. In contrast to the anomaly detection methods where anomalies are learned, DeepAnT uses unlabeled data to capture and learn the data distribution that is used to forecast the normal behavior of a time series. DeepAnT consists of two modules: time series predictor and anomaly detector. Thetime series predictormodule uses deep convolutional neural network (CNN) to predict the next time stamp on the defined horizon. This module takes a window of time series (used as a context) and attempts to predict the next time stamp. The predicted value is then passed to theanomaly detectormodule, which is responsible for tagging the corresponding time stamp as normal or abnormal. DeepAnT can be trained even without removing the anomalies from the given data set. Generally, in deep learning-based approaches, a lot of data are required to train a model. Whereas in DeepAnT, a model can be trained on relatively small data set while achieving good generalization capabilities due to the effective parameter sharing of the CNN. As the anomaly detection in DeepAnT is unsupervised, it does not rely on anomaly labels at the time of model generation. Therefore, this approach can be directly applied to real-life scenarios where it is practically impossible to label a big stream of data coming from heterogeneous sensors comprising of both normal as well as anomalous points. We have performed a detailed evaluation of 15 algorithms on 10 anomaly detection benchmarks, which contain a total of 433 real and synthetic time series. Experiments show that DeepAnT outperforms the state-of-the-art anomaly detection methods in most of the cases, while performing on par with others.
1
DeepAnT addresses the inability of traditional distance- and density-based methods to detect periodic and seasonality-related point anomalies in time series.
2
DeepAnT can be trained without removing anomalies and achieves good generalization on relatively small datasets through CNN parameter sharing, without requiring anomaly labels.
3
DeepAnT combines a deep convolutional neural network time-series predictor with an anomaly detector that labels forecast-discrepant timestamps as normal or abnormal.
4
The approach can detect point anomalies, contextual anomalies, and discords in both streaming and non-streaming time-series data.
5
The method uses unlabeled data to learn the normal data distribution through forecasting, rather than learning anomalies directly.

time series data from streaming and non-streaming sensor scenarios

unsupervised detection and classification of point, contextual, and discord anomalies based on learned normal temporal behavior

Publication Details
Publication Date
2018-12-19
Journal
Publisher
ISSN
Cited by
686
Access Type
Author Information
Authors
Andreas Dengel
Sheraz Ahmed
Mohsin Munir
Shoaib Ahmed Siddiqui
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%