paper-with-me

홈 › Papers

Multicalibration Boosting: Theory, Convergence, and Transferability

2026-05-23 · Hanxuan Ye, Hongzhe Li arxiv

Multicalibration extends classical calibration by requiring predictions to be unbiased over a rich collection of functions, encompassing both prediction slices and subpopulations. It has emerged as a powerful framework for fairness, robustness, and reliable prediction, yet the theoretical understanding of multicalibration boosting (MCBoost) remains fragmented and often relies on restrictive assumptions. In this work, we develop a unified and refined perspective on MCBoost that subsumes existing variants, including multiaccuracy, BatchGCP, and BatchMVP. We uncover several phenomena that provide new insights into its practical behavior: even highly accurate and flexible predictors can remain substantially miscalibrated; enforcing multicalibration introduces a calibration-risk trade-off; and early stopping plays a central role in controlling this trade-off. On the theoretical side, we establish a general framework for MCBoost under weaker and more realistic conditions. We show that the boosting iterates converge to a Bregman projection of the population-optimal predictor onto the cumulative span generated by the audit class, thereby explicitly characterizing the function space on which multicalibration is achieved. We further derive convergence rates under different smoothness assumptions, finite-sample guarantees, and principled stopping rules that ensure multicalibration at termination. Finally, we extend the theory of universal adaptability under covariate shift, providing more general transfer guarantees and clarifying when multicalibrated predictors generalize across domains. These results provide a more complete theoretical foundation and practical guidance for multicalibration boosting, positioning it as both a unifying framework and a reliable post-processing approach for modern predictive models.

📄 PDF Abstract BibTeX arXiv:2605.24364

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the Convergence of Multicalibration Gradient Boosting

2026-02-06 · Daniel Haimovich, Fridolin Linder, Lorenzo Perini, Niek Tax 외 arxiv

Multicalibration gradient boosting has recently emerged as a scalable method that empirically produces approximately multicalibrated predictors and has been deployed at web scale. Despite this empirical success, its conv…

Multicalibration as Boosting for Regression

2023-01-31 · Ira Globus-Harris, Declan Harrison, Michael Kearns, Aaron Roth 외

We study the connection between multicalibration and boosting for squared error regression. First we prove a useful characterization of multicalibration in terms of a ``swap regret'' like condition on squared error. Usin…

regression

An Exploration of Multicalibration Uniform Convergence Bounds

2022-02-09 · Harrison Rosenberg, Robi Bhattacharjee, Kassem Fawaz, Somesh Jha

Recent works have investigated the sample complexity necessary for fair machine learning. The most advanced of such sample complexity bounds are developed by analyzing multicalibration uniform convergence for a given pre…

BIG-bench Machine LearningFairness

Sample Complexity of Uniform Convergence for Multicalibration

2020-05-04 · NeurIPS 2020 12 · Eliran Shabat, Lee Cohen, Yishay Mansour

There is a growing interest in societal concerns in machine learning systems, especially in fairness. Multicalibration gives a comprehensive methodology to address group fairness. In this work, we address the multicalibr…

Fairness

The Scope of Multicalibration: Characterizing Multicalibration via Property Elicitation

2023-02-16 · Georgy Noarov, Aaron Roth

We make a connection between multicalibration and property elicitation and show that (under mild technical conditions) it is possible to produce a multicalibrated predictor for a continuous scalar distributional property…