Probabilistic Outlier Detection and Generation
A new method for outlier detection and generation is introduced by lifting data into the space of probability distributions which are not analytically expressible, but from which samples can be drawn using a neural generator. Given a mixture of unknown latent inlier and outlier distributions, a Wasserstein double autoencoder is used to both detect and generate inliers and outliers. The proposed method, named WALDO (Wasserstein Autoencoder for Learning the Distribution of Outliers), is evaluated on classical data sets including MNIST, CIFAR10 and KDD99 for detection accuracy and robustness. We give an example of outlier detection on a real retail sales data set and an example of outlier generation for simulating intrusion attacks. However we foresee many application scenarios where WALDO can be used. To the best of our knowledge this is the first work that studies both outlier detection and generation together.
Code (0)
등록된 구현이 없습니다.
Tasks
Outlier DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Probabilistic Transformation of Distance-Based Outliers
The scores of distance-based outlier detection methods are difficult to interpret, making it challenging to determine a cut-off threshold between normal and outlier data points without additional context. We describe a g…
Anomaly DetectionOutlier DetectionRobust Out-of-Distribution Detection on Deep Probabilistic Generative Models
Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood o…
Out-of-Distribution DetectionOut of Distribution (OOD) DetectionProbabilistic Robust Autoencoders for Outlier Detection
Anomalies (or outliers) are prevalent in real-world empirical observations and potentially mask important underlying structures. Accurate identification of anomalous samples is crucial for the success of downstream data …
Anomaly DetectionOutlier DetectionOutlier Detection on Mixed-Type Data: An Energy-based Approach
Outlier detection amounts to finding data points that differ significantly from the norm. Classic outlier detection methods are largely designed for single data type such as continuous or discrete. However, real world da…
Outlier DetectionVocal Bursts Type PredictionEfficient Generation of Hidden Outliers for Improved Outlier Detection
Outlier generation is a popular technique used for solving important outlier detection tasks. Generating outliers with realistic behavior is challenging. Popular existing methods tend to disregard the 'multiple views' pr…
Outlier Detection