Are generative deep models for novelty detection truly better?
Many deep models have been recently proposed for anomaly detection. This paper presents comparison of selected generative deep models and classical anomaly detection methods on an extensive number of non--image benchmark datasets. We provide statistical comparison of the selected models, in many configurations, architectures and hyperparamaters. We arrive to conclusion that performance of the generative models is determined by the process of selection of their hyperparameters. Specifically, performance of the deep generative models deteriorates with decreasing amount of anomalous samples used in hyperparameter selection. In practical scenarios of anomaly detection, none of the deep generative models systematically outperforms the kNN.
Code (1)
Tasks
Anomaly DetectionNovelty DetectionSimilar Papers 제목 키워드 기반
Improving novelty detection with generative adversarial networks on hand gesture data
We propose a novel way of solving the issue of classification of out-of-vocabulary gestures using Artificial Neural Networks (ANNs) trained in the Generative Adversarial Network (GAN) framework. A generative model augmen…
Generative Adversarial NetworkNovelty DetectionOAAE: Adversarial Autoencoders for Novelty Detection in Multi-modal Normality Case via Orthogonalized Latent Space
Novelty detection using deep generative models such as autoencoder, generative adversarial networks mostly takes image reconstruction error as novelty score function. However, image data, high dimensional as it is, conta…
Image ReconstructionNovelty DetectionDetecting bird sound in unknown acoustic background using crowdsourced training data
Biodiversity monitoring using audio recordings is achievable at a truly global scale via large-scale deployment of inexpensive, unattended recording stations or by large-scale crowdsourcing using recording and species re…
Novelty DetectionGenerative Models for Novelty Detection: Applications in abnormal event and situational change detection from data series
Novelty detection is a process for distinguishing the observations that differ in some respect from the observations that the model is trained on. Novelty detection is one of the fundamental requirements of a good classi…
Change DetectionNovelty DetectionOutlier DetectionNovelty Detection via Contrastive Learning with Negative Data Augmentation
Novelty detection is the process of determining whether a query example differs from the learned training distribution. Previous methods attempt to learn the representation of the normal samples via generative adversaria…
ClusteringContrastive LearningData AugmentationDecoder+3