Optimal Classification-based Anomaly Detection with Neural Networks: Theory and Practice
Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting anomaly detection into a binary classification problem, we establish non-asymptotic upper bounds and a convergence rate on the excess risk on rectified linear unit (ReLU) neural networks trained on synthetic anomalies. Our convergence rate on the excess risk matches the minimax optimal rate in the literature. Furthermore, we provide lower and upper bounds on the number of synthetic anomalies that can attain this optimality. For practical implementation, we relax some conditions to improve the search for the empirical risk minimizer, which leads to competitive performance to other classification-based methods for anomaly detection. Overall, our work provides the first theoretical guarantees of unsupervised neural network-based anomaly detectors and empirical insights on how to design them well.
Code (1)
Tasks
Anomaly DetectionBinary ClassificationUnsupervised Anomaly DetectionSimilar Papers 제목 키워드 기반
Autoencoders for Anomaly Detection are Unreliable
Autoencoders are frequently used for anomaly detection, both in the unsupervised and semi-supervised settings. They rely on the assumption that when trained using the reconstruction loss, they will be able to reconstruct…
Anomaly DetectionUniADC: A Unified Framework for Anomaly Detection and Classification
In this paper, we introduce a novel task termed unified anomaly detection and classification, which aims to simultaneously detect anomalous regions in images and identify their specific categories. Existing methods typic…
Anomaly DetectionUnsupervised Deep One-Class Classification with Adaptive Threshold based on Training Dynamics
One-class classification has been a prevailing method in building deep anomaly detection models under the assumption that a dataset consisting of normal samples is available. In practice, however, abnormal samples are of…
Anomaly DetectionOne-Class ClassificationOutlier DetectionBayesian Anomaly Detection Using Extreme Value Theory
Data-driven anomaly detection methods typically build a model for the normal behavior of the target system, and score each data instance with respect to this model. A threshold is invariably needed to identify data insta…
Anomaly DetectionClusteringReconstruction by Inpainting for Visual Anomaly Detection
Visual anomaly detection addresses the problem of classification or localization of regions in an image that deviate from their normal appearance. A popular approach trains an auto-encoder on anomaly-free images and perf…
Anomaly Detection