paper-with-me

Papers

PAC-Bayesian Generalization Guarantees for Fairness on Stochastic and Deterministic Classifiers

2026-02-12 · Julien Bastian, Benjamin Leblanc, Pascal Germain, Amaury Habrard, Christine Largeron, Guillaume Metzler, Emilie Morvant, Paul Viallard arxiv

Classical PAC generalization bounds on the prediction risk of a classifier are insufficient to provide theoretical guarantees on fairness when the goal is to learn models balancing predictive risk and fairness constraints. We propose a PAC-Bayesian framework for deriving generalization bounds for fairness, covering both stochastic and deterministic classifiers. For stochastic classifiers, we derive a fairness bound using standard PAC-Bayes techniques. Whereas for deterministic classifiers, as usual PAC-Bayes arguments do not apply directly, we leverage a recent advance in PAC-Bayes to extend the fairness bound beyond the stochastic setting. Our framework has two advantages: (i) It applies to a broad class of fairness measures that can be expressed as a risk discrepancy, and (ii) it leads to a self-bounding algorithm in which the learning procedure directly optimizes a trade-off between generalization bounds on the prediction risk and on the fairness. We empirically evaluate our framework with three classical fairness measures, demonstrating not only its usefulness but also the tightness of our bounds.

📄 PDF Abstract BibTeX arXiv:2602.11722

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the disintegration of the stochastic majority vote: From PAC-Bayesian bounds to a self-bounding algorithm

2026-09-15 · Julien Bastian, Benjamin Leblanc, Pascal Germain, Amaury Habrard 외 arxiv

Weighted majority votes are central to many successful ensemble methods. PAC-Bayesian theory provides tight generalization guarantees for such models by analyzing the expected risk of stochastic classifiers, while analyz…

A Framework for Bounding Deterministic Risk with PAC-Bayes: Applications to Majority Votes

2025-10-29 · Benjamin Leblanc, Pascal Germain arxiv

PAC-Bayes is a popular and efficient framework for obtaining generalization guarantees in situations involving uncountable hypothesis spaces. Unfortunately, in its classical formulation, it only provides guarantees on th…

Inference-time Stochastic Ranking with Risk Control

2023-06-12 · Ruocheng Guo, Jean-François Ton, Yang Liu, Hang Li

Learning to Rank (LTR) methods are vital in online economies, affecting users and item providers. Fairness in LTR models is crucial to allocate exposure proportionally to item relevance. Widely used deterministic LTR mod…

FairnessLearning-To-Rank

Deterministic PAC-Bayesian generalization bounds for deep networks via generalizing noise-resilience

2019-05-30 · ICLR 2019 5 · Vaishnavh Nagarajan, J. Zico Kolter

The ability of overparameterized deep networks to generalize well has been linked to the fact that stochastic gradient descent (SGD) finds solutions that lie in flat, wide minima in the training loss -- minima where the …

Generalization Bounds

Metric-Fair Classifier Derandomization

2022-06-15 · Jimmy Wu, Yatong Chen, Yang Liu

We study the problem of classifier derandomization in machine learning: given a stochastic binary classifier $f: X \to [0,1]$, sample a deterministic classifier $\hat{f}: X \to \{0,1\}$ that approximates the output of $f…

Fairness