paper-with-me

홈 › Papers

Robust outlier detection by de-biasing VAE likelihoods

2021-08-19 · CVPR 2022 1 · Kushal Chauhan, Barath Mohan U, Pradeep Shenoy, Manish Gupta, Devarajan Sridharan

Deep networks often make confident, yet, incorrect, predictions when tested with outlier data that is far removed from their training distributions. Likelihoods computed by deep generative models (DGMs) are a candidate metric for outlier detection with unlabeled data. Yet, previous studies have shown that DGM likelihoods are unreliable and can be easily biased by simple transformations to input data. Here, we examine outlier detection with variational autoencoders (VAEs), among the simplest of DGMs. We propose novel analytical and algorithmic approaches to ameliorate key biases with VAE likelihoods. Our bias corrections are sample-specific, computationally inexpensive, and readily computed for various decoder visible distributions. Next, we show that a well-known image pre-processing technique -- contrast stretching -- extends the effectiveness of bias correction to further improve outlier detection. Our approach achieves state-of-the-art accuracies with nine grayscale and natural image datasets, and demonstrates significant advantages -- both with speed and performance -- over four recent, competing approaches. In summary, lightweight remedies suffice to achieve robust outlier detection with VAEs.

📄 PDF Abstract BibTeX arXiv:2108.08760

Code (1)

google-research/google-research 공식 구현 tf

Tasks

DecoderOutlier Detection

Similar Papers 제목 키워드 기반

Shaken, and Stirred: Long-Range Dependencies Enable Robust Outlier Detection with PixelCNN++

2022-08-29 · Barath Mohan Umapathi, Kushal Chauhan, Pradeep Shenoy, Devarajan Sridharan

Reliable outlier detection is critical for real-world deployment of deep learning models. Although extensively studied, likelihoods produced by deep generative models have been largely dismissed as being impractical for …

Outlier Detection

Long-Term Outlier Prediction Through Outlier Score Modeling

2026-03-22 · Yuma Aoki, Joon Park, Koh Takeuchi, Hisashi Kashima 외 arxiv

This study addresses an important gap in time series outlier detection by proposing a novel problem setting: long-term outlier prediction. Conventional methods primarily focus on immediate detection by identifying deviat…

Outlier Detection

Finding Outliers in Gaussian Model-Based Clustering

2019-07-02 · Katharine M. Clark, Paul D. McNicholas

Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categori…

Clusteringmodel

Positive Difference Distribution for Image Outlier Detection using Normalizing Flows and Contrastive Data

2022-08-30 · Robert Schmier, Ullrich Köthe, Christoph-Nikolas Straehle

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perfor…

Anomaly DetectionOutlier Detection

Deep Anomaly Detection with Outlier Exposure

2018-12-11 · ICLR 2019 5 · Dan Hendrycks, Mantas Mazeika, Thomas Dietterich

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribut…

Anomaly DetectionOut-of-Distribution DetectionOut of Distribution (OOD) Detection