paper-with-me

홈 › Papers

Plugin estimators for selective classification with out-of-distribution detection

2023-01-29 · Harikrishna Narasimhan, Aditya Krishna Menon, Wittawat Jitkrittum, Sanjiv Kumar

Real-world classifiers can benefit from the option of abstaining from predicting on samples where they have low confidence. Such abstention is particularly useful on samples which are close to the learned decision boundary, or which are outliers with respect to the training sample. These settings have been the subject of extensive but disjoint study in the selective classification (SC) and out-of-distribution (OOD) detection literature. Recent work on selective classification with OOD detection (SCOD) has argued for the unified study of these problems; however, the formal underpinnings of this problem are still nascent, and existing techniques are heuristic in nature. In this paper, we propose new plugin estimators for SCOD that are theoretically grounded, effective, and generalise existing approaches from the SC and OOD detection literature. In the course of our analysis, we formally explicate how na\"{i}ve use of existing SC and OOD detection baselines may be inadequate for SCOD. We empirically demonstrate that our approaches yields competitive SC and OOD detection performance compared to baselines from both literatures.

📄 PDF Abstract BibTeX arXiv:2301.12386

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Plugin Estimation of Smooth Optimal Transport Maps

2021-07-26 · Tudor Manole, Sivaraman Balakrishnan, Jonathan Niles-Weed, Larry Wasserman

We analyze a number of natural estimators for the optimal transport map between two distributions and show that they are minimax optimal. We adopt the plugin approach: our estimators are simply optimal couplings between …

Stability Bounds for Smooth Optimal Transport Maps and their Statistical Implications

2025-02-17 · Sivaraman Balakrishnan, Tudor Manole

We study estimators of the optimal transport (OT) map between two probability distributions. We focus on plugin estimators derived from the OT map between estimates of the underlying distributions. We develop novel stabi…

SCOD: From Heuristics to Theory

2024-03-25 · Vojtech Franc, Jakub Paplham, Daniel Prusa

This paper addresses the problem of designing reliable prediction models that abstain from predictions when faced with uncertain or out-of-distribution samples - a recently proposed problem known as Selective Classificat…

Generative AI-Powered Plugin for Robust Federated Learning in Heterogeneous IoT Networks

2024-10-31 · YoungJoon Lee, Jinu Gong, Joonhyuk Kang

Federated learning enables edge devices to collaboratively train a global model while maintaining data privacy by keeping data localized. However, the Non-IID nature of data distribution across devices often hinders mode…

Data AugmentationFederated LearningPrivacy Preserving

Heavy-Tailed Process Priors for Selective Shrinkage

2010-12-01 · NeurIPS 2010 12 · Fabian L. Wauthier, Michael. I. Jordan

Heavy-tailed distributions are often used to enhance the robustness of regression and classification methods to outliers in output space. Often, however, we are confronted with ``outliers'' in input space, which are iso…

Gaussian ProcessesGeneral Classificationregression