Feature Density Estimation for Out-of-Distribution Detection via Normalizing Flows
Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD detection and present a fully unsupervised approach which requires no exposure to OOD data, avoiding researcher bias in OOD sample selection. This is a post-hoc method which can be applied to any pretrained model, and involves training a lightweight auxiliary normalizing flow model to perform the out-of-distribution detection via density thresholding. Experiments on OOD detection in image classification show strong results for far-OOD data detection with only a single epoch of flow training, including 98.2% AUROC for ImageNet-1k vs. Textures, which exceeds the state of the art by 7.8%. We additionally explore the connection between the feature space distribution of the pretrained model and the performance of our method. Finally, we provide insights into training pitfalls that have plagued normalizing flows for use in OOD detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Density Estimationimage-classificationImage ClassificationOut-of-Distribution DetectionOut of Distribution (OOD) DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time Series
Anomaly detection is a widely studied task for a broad variety of data types; among them, multiple time series appear frequently in applications, including for example, power grids and traffic networks. Detecting anomali…
Anomaly DetectionDensity EstimationTime SeriesTime Series Analysis+1Anomaly Detection in Trajectory Data with Normalizing Flows
The task of detecting anomalous data patterns is as important in practical applications as challenging. In the context of spatial data, recognition of unexpected trajectories brings additional difficulties, such as high …
Anomaly DetectionDensity EstimationOut-of-distribution detection using normalizing flows on the data manifold
Using the intuition that out-of-distribution data have lower likelihoods, a common approach for out-of-distribution detection involves estimating the underlying data distribution. Normalizing flows are likelihood-based g…
Density EstimationOut-of-Distribution DetectionInFlow: Robust outlier detection utilizing Normalizing Flows
Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inp…
Density EstimationOutlier DetectionOut of Distribution (OOD) DetectionTopology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning
To facilitate reliable deployments of autonomous robots in the real world, Out-of-Distribution (OOD) detection capabilities are often required. A powerful approach for OOD detection is based on density estimation with No…
2D Object DetectionDensity Estimationobject-detectionObject Detection+2