Probabilistic Robust Autoencoders for Outlier Detection
Anomalies (or outliers) are prevalent in real-world empirical observations and potentially mask important underlying structures. Accurate identification of anomalous samples is crucial for the success of downstream data analysis tasks. To automatically identify anomalies, we propose Probabilistic Robust AutoEncoder (PRAE). PRAE aims to simultaneously remove outliers and identify a low-dimensional representation for the inlier samples. We first present the Robust AutoEncoder (RAE) objective as a minimization problem for splitting the data into inliers and outliers. Our objective is designed to exclude outliers while including a subset of samples (inliers) that can be effectively reconstructed using an AutoEncoder (AE). RAE minimizes the autoencoder's reconstruction error while incorporating as many samples as possible. This could be formulated via regularization by subtracting an $\ell_0$ norm counting the number of selected samples from the reconstruction term. Unfortunately, this leads to an intractable combinatorial problem. Therefore, we propose two probabilistic relaxations of RAE, which are differentiable and alleviate the need for a combinatorial search. We prove that the solution to the PRAE problem is equivalent to the solution of RAE. We use synthetic data to show that PRAE can accurately remove outliers in a wide range of contamination levels. Finally, we demonstrate that using PRAE for anomaly detection leads to state-of-the-art results on various benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionOutlier DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Autoencoding Under Normalization Constraints
Likelihood is a standard estimate for outlier detection. The specific role of the normalization constraint is to ensure that the out-of-distribution (OOD) regime has a small likelihood when samples are learned using maxi…
Outlier DetectionSuppressing Outlier Reconstruction in Autoencoders for Out-of-Distribution Detection
While only trained to reconstruct training data, autoencoders may produce high-quality reconstructions of inputs that are well outside the training data distribution. This phenomenon, which we refer to as outlier recons…
Outlier DetectionOut-of-Distribution DetectionRobust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Version
Time series data occurs widely, and outlier detection is a fundamental problem in data mining, which has numerous applications. Existing autoencoder-based approaches deliver state-of-the-art performance on challenging re…
Outlier DetectionTime SeriesTime Series AnalysisUnsupervised Boosting-based Autoencoder Ensembles for Outlier Detection
Autoencoders, as a dimensionality reduction technique, have been recently applied to outlier detection. However, neural networks are known to be vulnerable to overfitting, and therefore have limited potential in the unsu…
Dimensionality ReductionDiversityOutlier DetectionDeep Variational Semi-Supervised Novelty Detection
In anomaly detection (AD), one seeks to identify whether a test sample is abnormal, given a data set of normal samples. A recent and promising approach to AD relies on deep generative models, such as variational autoenco…
Anomaly DetectionAstronomyNovelty DetectionOutlier Detection