paper-with-me

Papers

Learning Confidence for Out-of-Distribution Detection in Neural Networks

2018-02-13 · Terrance DeVries, Graham W. Taylor

Modern neural networks are very powerful predictive models, but they are often incapable of recognizing when their predictions may be wrong. Closely related to this is the task of out-of-distribution detection, where a network must determine whether or not an input is outside of the set on which it is expected to safely perform. To jointly address these issues, we propose a method of learning confidence estimates for neural networks that is simple to implement and produces intuitively interpretable outputs. We demonstrate that on the task of out-of-distribution detection, our technique surpasses recently proposed techniques which construct confidence based on the network's output distribution, without requiring any additional labels or access to out-of-distribution examples. Additionally, we address the problem of calibrating out-of-distribution detectors, where we demonstrate that misclassified in-distribution examples can be used as a proxy for out-of-distribution examples.

📄 PDF Abstract BibTeX arXiv:1802.04865

Code (5)

uoguelph-mlrg/confidence_estimation 공식 구현 pytorch
Janus-Shiau/ood_confidence_tensorflow tf
jun-cen/unified_open_set_recognition pytorch
kkirchheim/pytorch-ood pytorch
oliverzhang42/ood_medical_images pytorch

Tasks

Out-of-Distribution Detection

Similar Papers 제목 키워드 기반

Distribution-free changepoint localization after sequential change detection

2026-05-31 · Aytijhya Saha, Aaditya Ramdas arxiv

This paper introduces a distribution-free framework for constructing post-detection confidence sets for changepoints after stopping a sequential change detection procedure. It is well known that conformal test martingale…

Change Detection

Confidence Estimation for Automatic Detection of Depression and Alzheimer's Disease Based on Clinical Interviews

2024-07-29 · Wen Wu, Chao Zhang, Philip C. Woodland

Speech-based automatic detection of Alzheimer's disease (AD) and depression has attracted increased attention. Confidence estimation is crucial for a trust-worthy automatic diagnostic system which informs the clinician a…

Diagnostic

Energy-based Out-of-distribution Detection

2020-10-08 · NeurIPS 2020 12 · Weitang Liu, XiaoYun Wang, John D. Owens, Yixuan Li

Determining whether inputs are out-of-distribution (OOD) is an essential building block for safely deploying machine learning models in the open world. However, previous methods relying on the softmax confidence score su…

Out-of-Distribution Detection

Prior Distribution and Model Confidence

2025-09-05 · Maksim Kazanskii, Artem Kasianov arxiv

We study how the training data distribution affects confidence and performance in image classification models. We introduce Embedding Density, a model-agnostic framework that estimates prediction confidence by measuring …

Image Classification

Bayesian Confidence Calibration for Epistemic Uncertainty Modelling

2021-09-21 · Fabian Küppers, Jan Kronenberger, Jonas Schneider, Anselm Haselhoff

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for …

object-detectionObject DetectionVariational Inference