paper-with-me

홈 › Papers

Classification with abstention but without disparities

2021-02-24 · Nicolas Schreuder, Evgenii Chzhen

Classification with abstention has gained a lot of attention in recent years as it allows to incorporate human decision-makers in the process. Yet, abstention can potentially amplify disparities and lead to discriminatory predictions. The goal of this work is to build a general purpose classification algorithm, which is able to abstain from prediction, while avoiding disparate impact. We formalize this problem as risk minimization under fairness and abstention constraints for which we derive the form of the optimal classifier. Building on this result, we propose a post-processing classification algorithm, which is able to modify any off-the-shelf score-based classifier using only unlabeled sample. We establish finite sample risk, fairness, and abstention guarantees for the proposed algorithm. In particular, it is shown that fairness and abstention constraints can be achieved independently from the initial classifier as long as sufficiently many unlabeled data is available. The risk guarantee is established in terms of the quality of the initial classifier. Our post-processing scheme reduces to a sparse linear program allowing for an efficient implementation, which we provide. Finally, we validate our method empirically showing that moderate abstention rates allow to bypass the risk-fairness trade-off.

📄 PDF Abstract BibTeX arXiv:2102.12258

Code (1)

evgchz/dpabst 공식 구현

Tasks

ClassificationFairnessGeneral Classification

Similar Papers 제목 키워드 기반

Selective Classification Can Magnify Disparities Across Groups

2020-10-27 · ICLR 2021 1 · Erik Jones, Shiori Sagawa, Pang Wei Koh, Ananya Kumar 외

Selective classification, in which models can abstain on uncertain predictions, is a natural approach to improving accuracy in settings where errors are costly but abstentions are manageable. In this paper, we find that …

ClassificationGeneral Classification

MOBA: A multi-objective bounded-abstention model for two-class cost-sensitive problems

2019-05-17 · Hongjiao Guan

Abstaining classifiers have been widely used in cost-sensitive applications to avoid ambiguous classification and reduce the cost of misclassification. Previous abstaining classification models rely on cost information, …

ClassificationGeneral Classification

Teaching LLMs to Abstain across Languages via Multilingual Feedback

2024-06-22 · Shangbin Feng, Weijia Shi, Yike Wang, Wenxuan Ding 외

Multilingual LLMs often have knowledge disparities across languages, with larger gaps in under-resourced languages. Teaching LLMs to abstain in the face of knowledge gaps is thus a promising strategy to mitigate hallucin…

Language ModelingLanguage Modelling

AbstainGNN: Teaching Graph Neural Networks to Abstain for Graph Classification

2026-05-29 · Xixun Lin, Zhiheng Zhou, Zhengyin Zhang, Yancheng Chen 외 arxiv

Graph classification is a core task in graph data mining with widespread real-world applications. Recent advances in graph neural networks (GNNs) have led to substantial performance improvements for graph classification.…

Graph Classification

When In Doubt, Abstain: The Impact of Abstention on Strategic Classification

2025-10-15 · Lina Alkarmi, Ziyuan Huang, Mingyan Liu arxiv

Algorithmic decision making is increasingly prevalent, but often vulnerable to strategic manipulation by agents seeking a favorable outcome. Prior research has shown that classifier abstention (allowing a classifier to d…

Decision Making