paper-with-me

Papers

Knows When it Doesn’t Know: Deep Abstaining Classifiers

2019-05-01 · ICLR 2019 5 · Sunil Thulasidasan, Tanmoy Bhattacharya, Jeffrey Bilmes, Gopinath Chennupati, Jamal Mohd-Yusof

We introduce the deep abstaining classifier -- a deep neural network trained with a novel loss function that provides an abstention option during training. This allows the DNN to abstain on confusing or difficult-to-learn examples while improving performance on the non-abstained samples. We show that such deep abstaining classifiers can: (i) learn representations for structured noise -- where noisy training labels or confusing examples are correlated with underlying features -- and then learn to abstain based on such features; (ii) enable robust learning in the presence of arbitrary or unstructured noise by identifying noisy samples; and (iii) be used as an effective out-of-category detector that learns to reliably abstain when presented with samples from unknown classes. We provide analytical results on loss function behavior that enable automatic tuning of accuracy and coverage, and demonstrate the utility of the deep abstaining classifier using multiple image benchmarks, Results indicate significant improvement in learning in the presence of label noise.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Counterfactually Comparing Abstaining Classifiers

2023-05-17 · NeurIPS 2023 11 · Yo Joong Choe, Aditya Gangrade, Aaditya Ramdas

Abstaining classifiers have the option to abstain from making predictions on inputs that they are unsure about. These classifiers are becoming increasingly popular in high-stakes decision-making problems, as they can wit…

Causal InferencecounterfactualDecision Making

Interpretable and Fair Mechanisms for Abstaining Classifiers

2025-03-24 · Daphne Lenders, Andrea Pugnana, Roberto Pellungrini, Toon Calders 외

Abstaining classifiers have the option to refrain from providing a prediction for instances that are difficult to classify. The abstention mechanism is designed to trade off the classifier's performance on the accepted d…

Fairness

Fair Classifiers that Abstain without Harm

2023-10-09 · Tongxin Yin, Jean-François Ton, Ruocheng Guo, Yuanshun Yao 외

In critical applications, it is vital for classifiers to defer decision-making to humans. We propose a post-hoc method that makes existing classifiers selectively abstain from predicting certain samples. Our abstaining c…

Decision MakingFairness

A New Strategy of Cost-Free Learning in the Class Imbalance Problem

2013-07-22 · Xiaowan Zhang, Bao-Gang Hu

In this work, we define cost-free learning (CFL) formally in comparison with cost-sensitive learning (CSL). The main difference between them is that a CFL approach seeks optimal classification results without requiring a…

General Classification

Abstaining Classification When Error Costs are Unequal and Unknown

2018-06-09 · Hongjiao Guan, Yingtao Zhang, H. D. Cheng, Xianglong Tang

Abstaining classificaiton aims to reject to classify the easily misclassified examples, so it is an effective approach to increase the clasificaiton reliability and reduce the misclassification risk in the cost-sensitive…

ClassificationGeneral Classification