A Uniform Framework for Anomaly Detection in Deep Neural Networks
Deep neural networks (DNN) can achieve high performance when applied to In-Distribution (ID) data which come from the same distribution as the training set. When presented with anomaly inputs not from the ID, the outputs of a DNN should be regarded as meaningless. However, modern DNN often predict anomaly inputs as an ID class with high confidence, which is dangerous and misleading. In this work, we consider three classes of anomaly inputs, (1) natural inputs from a different distribution than the DNN is trained for, known as Out-of-Distribution (OOD) samples, (2) crafted inputs generated from ID by attackers, often known as adversarial (AD) samples, and (3) noise (NS) samples generated from meaningless data. We propose a framework that aims to detect all these anomalies for a pre-trained DNN. Unlike some of the existing works, our method does not require preprocessing of input data, nor is it dependent to any known OOD set or adversarial attack algorithm. Through extensive experiments over a variety of DNN models for the detection of aforementioned anomalies, we show that in most cases our method outperforms state-of-the-art anomaly detection methods in identifying all three classes of anomalies.
Code (1)
Tasks
Adversarial AttackAnomaly DetectionSimilar Papers 제목 키워드 기반
UniFormaly: Towards Task-Agnostic Unified Framework for Visual Anomaly Detection
Visual anomaly detection aims to learn normality from normal images, but existing approaches are fragmented across various tasks: defect detection, semantic anomaly detection, multi-class anomaly detection, and anomaly c…
Anomaly DetectionDefect DetectionMulti-class Anomaly DetectionMultiple Instance LearningA Deep Learning Approach to Anomaly Sequence Detection for High-Resolution Monitoring of Power Systems
A deep learning approach is proposed to detect data and system anomalies using high-resolution continuous point-on-wave (CPOW) or phasor measurements. Both the anomaly and anomaly-free measurement models are assumed to h…
Anomaly DetectionGenerative Adversarial NetworkSiamese Transition Masked Autoencoders as Uniform Unsupervised Visual Anomaly Detector
Unsupervised visual anomaly detection conveys practical significance in many scenarios and is a challenging task due to the unbounded definition of anomalies. Moreover, most previous methods are application-specific, and…
Anomaly DetectionDecoderBatch Uniformization for Minimizing Maximum Anomaly Score of DNN-based Anomaly Detection in Sounds
Use of an autoencoder (AE) as a normal model is a state-of-the-art technique for unsupervised-anomaly detection in sounds (ADS). The AE is trained to minimize the sample mean of the anomaly score of normal sounds in a mi…
Anomaly DetectionDensity EstimationUnsupervised Anomaly DetectionIM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturing
Image anomaly detection (IAD) is an emerging and vital computer vision task in industrial manufacturing (IM). Recently, many advanced algorithms have been reported, but their performance deviates considerably with variou…
Anomaly DetectionContinual LearningFew-Shot Learning