paper-with-me

홈 › Papers

How Global Calibration Strengthens Multiaccuracy

2025-04-21 · Sílvia Casacuberta, Parikshit Gopalan, Varun Kanade, Omer Reingold

Multiaccuracy and multicalibration are multigroup fairness notions for prediction that have found numerous applications in learning and computational complexity. They can be achieved from a single learning primitive: weak agnostic learning. Here we investigate the power of multiaccuracy as a learning primitive, both with and without the additional assumption of calibration. We find that multiaccuracy in itself is rather weak, but that the addition of global calibration (this notion is called calibrated multiaccuracy) boosts its power substantially, enough to recover implications that were previously known only assuming the stronger notion of multicalibration. We give evidence that multiaccuracy might not be as powerful as standard weak agnostic learning, by showing that there is no way to post-process a multiaccurate predictor to get a weak learner, even assuming the best hypothesis has correlation $1/2$. Rather, we show that it yields a restricted form of weak agnostic learning, which requires some concept in the class to have correlation greater than $1/2$ with the labels. However, by also requiring the predictor to be calibrated, we recover not just weak, but strong agnostic learning. A similar picture emerges when we consider the derivation of hardcore measures from predictors satisfying multigroup fairness notions. On the one hand, while multiaccuracy only yields hardcore measures of density half the optimal, we show that (a weighted version of) calibrated multiaccuracy achieves optimal density. Our results yield new insights into the complementary roles played by multiaccuracy and calibration in each setting. They shed light on why multiaccuracy and global calibration, although not particularly powerful by themselves, together yield considerably stronger notions.

📄 PDF Abstract BibTeX arXiv:2504.15206

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Multiaccuracy and Multicalibration via Proxy Groups

2025-03-04 · Beepul Bharti, Mary Versa Clemens-Sewall, Paul H. Yi, Jeremias Sulam

As the use of predictive machine learning algorithms increases in high-stakes decision-making, it is imperative that these algorithms are fair across sensitive groups. Unfortunately, measuring and enforcing fairness in r…

Fairness

Generalized and Unified Equivalences between Hardness and Pseudoentropy

2025-07-08 · Lunjia Hu, Salil Vadhan arxiv

Pseudoentropy characterizations provide a quantitatively precise demonstration of the close relationship between computational hardness and computational randomness. We prove a unified pseudoentropy characterization that…

Low-Degree Multicalibration

2022-03-02 · Parikshit Gopalan, Michael P. Kim, Mihir Singhal, Shengjia Zhao

Introduced as a notion of algorithmic fairness, multicalibration has proved to be a powerful and versatile concept with implications far beyond its original intent. This stringent notion -- that predictions be well-calib…

Fairness

Loss Minimization through the Lens of Outcome Indistinguishability

2022-10-16 · Parikshit Gopalan, Lunjia Hu, Michael P. Kim, Omer Reingold 외

We present a new perspective on loss minimization and the recent notion of Omniprediction through the lens of Outcome Indistingusihability. For a collection of losses and hypothesis class, omniprediction requires that a …

Fairness

Multiaccuracy: Black-Box Post-Processing for Fairness in Classification

2018-05-31 · Michael P. Kim, Amirata Ghorbani, James Zou

Prediction systems are successfully deployed in applications ranging from disease diagnosis, to predicting credit worthiness, to image recognition. Even when the overall accuracy is high, these systems may exhibit system…

ClassificationFairnessGeneral Classificationimage-classification+1