Equalized odds postprocessing under imperfect group information

2019-06-07 · Pranjal Awasthi, Matthäus Kleindessner, Jamie Morgenstern

Most approaches aiming to ensure a model's fairness with respect to a protected attribute (such as gender or race) assume to know the true value of the attribute for every data point. In this paper, we ask to what extent fairness interventions can be effective even when only imperfect information about the protected attribute is available. In particular, we study the prominent equalized odds postprocessing method of Hardt et al. (2016) under a perturbation of the attribute. We identify conditions on the perturbation that guarantee that the bias of a classifier is reduced even by running equalized odds with the perturbed attribute. We also study the error of the resulting classifier. We empirically observe that under our identified conditions most often the error does not suffer from a perturbation of the protected attribute. For a special case, we formally prove this observation to be true.

📄 PDF Abstract BibTeX arXiv:1906.03284

Code (2)

matthklein/equalized_odds_under_perturbation 공식 구현

matthklein/equalized_odds_with_perturbed_attribute

Tasks

AttributeFairness General Classification

FairBalance: How to Achieve Equalized Odds With Data Pre-processing

2021-07-17 · Zhe Yu, Joymallya Chakraborty, Tim Menzies

This research seeks to benefit the software engineering society by providing a simple yet effective pre-processing approach to achieve equalized odds fairness in machine learning software. Fairness issues have attracted …

BIG-bench Machine Learning Fairness

Evaluating Machine Learning-based Skin Cancer Diagnosis

2024-09-04 · Tanish Jain

This study evaluates the reliability of two deep learning models for skin cancer detection, focusing on their explainability and fairness. Using the HAM10000 dataset of dermatoscopic images, the research assesses two con…

Fairness

Paradoxes in Fair Machine Learning

2019-12-01 · NeurIPS 2019 12 · Paul Goelz, Anson Kahng, Ariel D. Procaccia

Equalized odds is a statistical notion of fairness in machine learning that ensures that classification algorithms do not discriminate against protected groups. We extend equalized odds to the setting of cardinality-cons…

BIG-bench Machine Learning Fairness General Classification

Worst-Group Equalized Odds Regularization for Multi-Attribute Fair Medical Image Classification

2026-05-19 · Nikhil Cherian Kurian, Victor Caquilpan Parra, Abin Shoby, Luke Whitbread 외 arxiv

Diagnostic performance in medical AI varies systematically across demographic groups, yet subgroup AUC can mask clinically important disparities. At a fixed inference-time operating point, some groups may exhibit over-di…

Medical Image Classification

Achieving Equalized Odds by Resampling Sensitive Attributes

2020-06-08 · NeurIPS 2020 12 · Yaniv Romano, Stephen Bates, Emmanuel J. Candès

We present a flexible framework for learning predictive models that approximately satisfy the equalized odds notion of fairness. This is achieved by introducing a general discrepancy functional that rigorously quantifies…

Attribute Fairness Multi-class Classification Two-sample testing+1