paper-with-me

Papers

Quantile-based Maximum Likelihood Training for Outlier Detection

2023-08-20 · Masoud Taghikhah, Nishant Kumar, Siniša Šegvić, Abouzar Eslami, Stefan Gumhold

Discriminative learning effectively predicts true object class for image classification. However, it often results in false positives for outliers, posing critical concerns in applications like autonomous driving and video surveillance systems. Previous attempts to address this challenge involved training image classifiers through contrastive learning using actual outlier data or synthesizing outliers for self-supervised learning. Furthermore, unsupervised generative modeling of inliers in pixel space has shown limited success for outlier detection. In this work, we introduce a quantile-based maximum likelihood objective for learning the inlier distribution to improve the outlier separation during inference. Our approach fits a normalizing flow to pre-trained discriminative features and detects the outliers according to the evaluated log-likelihood. The experimental evaluation demonstrates the effectiveness of our method as it surpasses the performance of the state-of-the-art unsupervised methods for outlier detection. The results are also competitive compared with a recent self-supervised approach for outlier detection. Our work allows to reduce dependency on well-sampled negative training data, which is especially important for domains like medical diagnostics or remote sensing.

📄 PDF Abstract BibTeX arXiv:2310.06085

Code (1)

taghikhah/quantod 공식 구현 pytorch

Tasks

Autonomous DrivingContrastive Learningimage-classificationImage ClassificationOutlier DetectionSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Maximum Likelihood Uncertainty Estimation: Robustness to Outliers

2022-02-03 · Deebul S. Nair, Nico Hochgeschwender, Miguel A. Olivares-Mendez

We benchmark the robustness of maximum likelihood based uncertainty estimation methods to outliers in training data for regression tasks. Outliers or noisy labels in training data results in degraded performances as well…

Depth EstimationMonocular Depth Estimationregression

Beta quantile regression for robust estimation of uncertainty in the presence of outliers

2023-09-14 · Haleh Akrami, Omar Zamzam, Anand Joshi, Sergul Aydore 외

Quantile Regression (QR) can be used to estimate aleatoric uncertainty in deep neural networks and can generate prediction intervals. Quantifying uncertainty is particularly important in critical applications such as cli…

Anomaly DetectionImage ReconstructionPrediction Intervalsquantile regression+2

Autoencoding Under Normalization Constraints

2021-05-12 · Sangwoong Yoon, Yung-Kyun Noh, Frank Chongwoo Park

Likelihood is a standard estimate for outlier detection. The specific role of the normalization constraint is to ensure that the out-of-distribution (OOD) regime has a small likelihood when samples are learned using maxi…

Outlier Detection

Autoregressive Quantile Flows for Predictive Uncertainty Estimation

2021-12-09 · ICLR 2022 4 · Phillip Si, Allan Bishop, Volodymyr Kuleshov

Numerous applications of machine learning involve representing probability distributions over high-dimensional data. We propose autoregressive quantile flows, a flexible class of normalizing flow models trained using a n…

Density Estimationobject-detectionObject Detectionregression+3

Positive Difference Distribution for Image Outlier Detection using Normalizing Flows and Contrastive Data

2022-08-30 · Robert Schmier, Ullrich Köthe, Christoph-Nikolas Straehle

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perfor…

Anomaly DetectionOutlier Detection