A Unifying Review of Deep and Shallow Anomaly Detection
Унифицирующий обзор глубоких и поверхностных методов обнаружения аномалий
2021-02-05
SCID: 54.1/pwbgssyq
Discuss with AI
anomaly detectiondeep learningexplainable anomaly detectionone-class classificationshallow methods
Figures from the paper
Abstract (AI)
Deep learning approaches to anomaly detection (AD) have recently improved the state of the art in detection performance on complex data sets, such as large collections of images or text. These results have sparked a renewed interest in the AD problem and led to the introduction of a great variety of new methods. With the emergence of numerous such methods, including approaches based on generative models, one-class classification, and reconstruction, there is a growing need to bring methods of this field into a systematic and unified perspective. In this review, we aim to identify the common underlying principles and the assumptions that are often made implicitly by various methods. In particular, we draw connections between classic “shallow” and novel deep approaches and show how this relation might cross-fertilize or extend both directions. We further provide an empirical assessment of major existing methods that are enriched by the use of recent explainability techniques and present specific worked-through examples together with practical advice. Finally, we outline critical open challenges and identify specific paths for future research in AD.
Key Findings
1
Deep learning has recently improved anomaly-detection performance on complex datasets, including large image and text collections.
2
It establishes conceptual connections between classic shallow and modern deep anomaly-detection approaches, suggesting opportunities for cross-fertilization and extension.
3
It identifies critical open challenges and proposes specific directions for future anomaly-detection research.
4
The review empirically assesses major anomaly-detection methods using recent explainability techniques, worked examples, and practical guidance.
5
The review unifies generative-model, one-class-classification, and reconstruction-based methods by identifying their shared principles and implicit assumptions.
Research Object
Deep and shallow anomaly detection methods for complex data sets
Research Subject
Underlying principles, implicit assumptions, relationships, empirical performance, and explainability of anomaly detection methods
Publication Details
Publication Date
2021-02-05
Journal
Publisher
ISSN
Cited by
884
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai16
ImageNet: A large-scale hierarchical image database2009
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
Reducing the Dimensionality of Data with Neural Networks2006
Neural networks and physical systems with emergent collective computational abilities.1982
"Why Should I Trust You?"2016
Representation Learning: A Review and New Perspectives2013
Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups2012
Enriching Word Vectors with Subword Information2017
Speech recognition with deep recurrent neural networks2013
Image Style Transfer Using Convolutional Neural Networks2016
Isolation Forest2008
Semi-Supervised Learning2006
Machine Learning and Deep Learning Methods for Cybersecurity2018
A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data2016
Unsupervised real-time anomaly detection for streaming data2017
Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications2018