Quantile-based Maximum Likelihood Training for Outlier Detection
Discriminative learning effectively predicts true object class for image classification. However, it often results in false positives for outliers, posing critical concerns in applications like autonomous driving and video surveillance systems. Previous attempts to address this challenge involved training image classifiers through contrastive learning using actual outlier data or synthesizing outliers for self-supervised learning. Furthermore, unsupervised generative modeling of inliers in pixel space has shown limited success for outlier detection. In this work, we introduce a quantile-based maximum likelihood objective for learning the inlier distribution to improve the outlier separation during inference. Our approach fits a normalizing flow to pre-trained discriminative features and detects the outliers according to the evaluated log-likelihood. The experimental evaluation demonstrates the effectiveness of our method as it surpasses the performance of the state-of-the-art unsupervised methods for outlier detection. The results are also competitive compared with a recent self-supervised approach for outlier detection. Our work allows to reduce dependency on well-sampled negative training data, which is especially important for domains like medical diagnostics or remote sensing.
Code (1)
Tasks
Autonomous DrivingContrastive Learningimage-classificationImage ClassificationOutlier DetectionSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Maximum Likelihood Uncertainty Estimation: Robustness to Outliers
We benchmark the robustness of maximum likelihood based uncertainty estimation methods to outliers in training data for regression tasks. Outliers or noisy labels in training data results in degraded performances as well…
Depth EstimationMonocular Depth EstimationregressionBeta quantile regression for robust estimation of uncertainty in the presence of outliers
Quantile Regression (QR) can be used to estimate aleatoric uncertainty in deep neural networks and can generate prediction intervals. Quantifying uncertainty is particularly important in critical applications such as cli…
Anomaly DetectionImage ReconstructionPrediction Intervalsquantile regression+2Autoencoding Under Normalization Constraints
Likelihood is a standard estimate for outlier detection. The specific role of the normalization constraint is to ensure that the out-of-distribution (OOD) regime has a small likelihood when samples are learned using maxi…
Outlier DetectionAutoregressive Quantile Flows for Predictive Uncertainty Estimation
Numerous applications of machine learning involve representing probability distributions over high-dimensional data. We propose autoregressive quantile flows, a flexible class of normalizing flow models trained using a n…
Density Estimationobject-detectionObject Detectionregression+3Positive Difference Distribution for Image Outlier Detection using Normalizing Flows and Contrastive Data
Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perfor…
Anomaly DetectionOutlier Detection