paper-with-me

Papers

Multi-group Agnostic PAC Learnability

2021-05-20 · Guy N Rothblum, Gal Yona

An agnostic PAC learning algorithm finds a predictor that is competitive with the best predictor in a benchmark hypothesis class, where competitiveness is measured with respect to a given loss function. However, its predictions might be quite sub-optimal for structured subgroups of individuals, such as protected demographic groups. Motivated by such fairness concerns, we study "multi-group agnostic PAC learnability": fixing a measure of loss, a benchmark class $\H$ and a (potentially) rich collection of subgroups $\G$, the objective is to learn a single predictor such that the loss experienced by every group $g \in \G$ is not much larger than the best possible loss for this group within $\H$. Under natural conditions, we provide a characterization of the loss functions for which such a predictor is guaranteed to exist. For any such loss function we construct a learning algorithm whose sample complexity is logarithmic in the size of the collection $\G$. Our results unify and extend previous positive and negative results from the multi-group fairness literature, which applied for specific loss functions.

📄 PDF Abstract BibTeX arXiv:2105.09989

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessPAC learning

Similar Papers 제목 키워드 기반

Distribution Learnability and Robustness

2024-06-25 · NeurIPS 2023 11 · Shai Ben-David, Alex Bie, Gautam Kamath, Tosca Lechner

We examine the relationship between learnability and robust (or agnostic) learnability for the problem of distribution learning. We show that, contrary to other learning settings (e.g., PAC learning of function classes),…

PAC learning

On statistical learning via the lens of compression

2016-10-12 · Ofir David, Shay Moran, Amir Yehudayoff

This work continues the study of the relationship between sample compression schemes and statistical learning, which has been mostly investigated within the framework of binary classification. The central theme of this w…

Binary ClassificationLearning Theory

Supervised learning through the lens of compression

2016-12-01 · NeurIPS 2016 12 · Ofir David, Shay Moran, Amir Yehudayoff

This work continues the study of the relationship between sample compression schemes and statistical learning, which has been mostly investigated within the framework of binary classification. We first extend the investi…

Binary Classification

Stability and List-Replicability for Agnostic Learners

2025-01-09 · Ari Blondal, Shan Gao, Hamed Hatami, Pooya Hatami

Two seminal papers--Alon, Livni, Malliaris, Moran (STOC 2019) and Bun, Livni, and Moran (FOCS 2020)--established the equivalence between online learnability and globally stable PAC learnability in binary classification. …

Binary Classification

A Theory of Optimistically Universal Online Learnability for General Concept Classes

2025-01-15 · Steve Hanneke, Hongao Wang

We provide a full characterization of the concept classes that are optimistically universally online learnable with $\{0, 1\}$ labels. The notion of optimistically universal online learning was defined in [Hanneke, 2021]…

Philosophy