Deep Variational Semi-Supervised Novelty Detection
In anomaly detection (AD), one seeks to identify whether a test sample is abnormal, given a data set of normal samples. A recent and promising approach to AD relies on deep generative models, such as variational autoencoders (VAEs), for unsupervised learning of the normal data distribution. In semi-supervised AD (SSAD), the data also includes a small sample of labeled anomalies. In this work, we propose two variational methods for training VAEs for SSAD. The intuitive idea in both methods is to train the encoder to `separate' between latent vectors for normal and outlier data. We show that this idea can be derived from principled probabilistic formulations of the problem, and propose simple and effective algorithms. Our methods can be applied to various data types, as we demonstrate on SSAD datasets ranging from natural images to astronomy and medicine, can be combined with any VAE model architecture, and are naturally compatible with ensembling. When comparing to state-of-the-art SSAD methods that are not specific to particular data types, we obtain marked improvement in outlier detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionAstronomyNovelty DetectionOutlier DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Application of SsVGMM to medical data-classification with novelty detection
There is a considerable demand to apply classification in medical analysis. A traditional classifier requires training samples from each class. However, in reality, it is possible that the testing set may include courses…
ClassificationMulti-class ClassificationNovelty DetectionGenerative Models for Novelty Detection: Applications in abnormal event and situational change detection from data series
Novelty detection is a process for distinguishing the observations that differ in some respect from the observations that the model is trained on. Novelty detection is one of the fundamental requirements of a good classi…
Change DetectionNovelty DetectionOutlier DetectionUnsupervised Novelty Detection Methods Benchmarking with Wavelet Decomposition
Novelty detection is a critical task in various engineering fields. Numerous approaches to novelty detection rely on supervised or semi-supervised learning, which requires labelled datasets for training. However, acquiri…
BenchmarkingNovelty DetectionImproving Novelty Detection using the Reconstructions of Nearest Neighbours
We show that using nearest neighbours in the latent space of autoencoders (AE) significantly improves performance of semi-supervised novelty detection in both single and multi-class contexts. Autoencoding methods detect …
Anomaly DetectionData AugmentationNovelty DetectionSemi-supervised novelty detection using ensembles with regularized disagreement
Deep neural networks often predict samples with high confidence even when they come from unseen classes and should instead be flagged for expert evaluation. Current novelty detection algorithms cannot reliably identify s…
Novelty DetectionOut-of-Distribution DetectionOut of Distribution (OOD) Detection