paper-with-me

홈 › Papers

Density of States Estimation for Out-of-Distribution Detection

2020-06-16 · Warren R. Morningstar, Cusuh Ham, Andrew G. Gallagher, Balaji Lakshminarayanan, Alexander A. Alemi, Joshua V. Dillon

Perhaps surprisingly, recent studies have shown probabilistic model likelihoods have poor specificity for out-of-distribution (OOD) detection and often assign higher likelihoods to OOD data than in-distribution data. To ameliorate this issue we propose DoSE, the density of states estimator. Drawing on the statistical physics notion of `density of states,'' the DoSE decision rule avoids direct comparison of model probabilities, and instead utilizes the probability of the model probability,'' or indeed the frequency of any reasonable statistic. The frequency is calculated using nonparametric density estimators (e.g., KDE and one-class SVM) which measure the typicality of various model statistics given the training data and from which we can flag test points with low typicality as anomalous. Unlike many other methods, DoSE requires neither labeled data nor OOD examples. DoSE is modular and can be trivially applied to any existing, trained model. We demonstrate DoSE's state-of-the-art performance against other unsupervised OOD detectors on previously established `hard'' benchmarks.

📄 PDF Abstract BibTeX arXiv:2006.09273

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution DetectionOut of Distribution (OOD) DetectionSpecificity

Similar Papers 제목 키워드 기반

Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Control

2022-06-21 · Katie Kang, Paula Gradu, Jason Choi, Michael Janner 외

Learned models and policies can generalize effectively when evaluated within the distribution of the training data, but can produce unpredictable and erroneous outputs on out-of-distribution inputs. In order to avoid dis…

Density Estimation

Out-of-Distribution Detection with Class Ratio Estimation

2022-06-08 · Mingtian Zhang, Andi Zhang, Tim Z. Xiao, Yitong Sun 외

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typica…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Flow-Based Density Ratio Estimation for Intractable Distributions with Applications in Genomics

2026-02-27 · Egor Antipov, Alessandro Palma, Lorenzo Consoli, Stephan Günnemann 외 arxiv

Estimating density ratios between pairs of intractable data distributions is a core problem in probabilistic modeling, enabling principled comparisons of sample likelihoods under different data-generating processes acros…

Hybrid Energy Based Model in the Feature Space for Out-of-Distribution Detection

2023-05-26 · Marc Lafon, Elias Ramzi, Clément Rambour, Nicolas Thome

Out-of-distribution (OOD) detection is a critical requirement for the deployment of deep neural networks. This paper introduces the HEAT model, a new post-hoc OOD detection method estimating the density of in-distributio…

Density EstimationOut-of-Distribution DetectionOut of Distribution (OOD) Detection

A Local Density-Based Approach for Local Outlier Detection

2016-06-28 · Bo Tang, Haibo He

This paper presents a simple but effective density-based outlier detection approach with the local kernel density estimation (KDE). A Relative Density-based Outlier Score (RDOS) is introduced to measure the local outlier…

Density EstimationObjectOutlier Detection