paper-with-me

홈 › Papers

Post-processing for Individual Fairness

2021-10-26 · NeurIPS 2021 12 · Felix Petersen, Debarghya Mukherjee, Yuekai Sun, Mikhail Yurochkin

Post-processing in algorithmic fairness is a versatile approach for correcting bias in ML systems that are already used in production. The main appeal of post-processing is that it avoids expensive retraining. In this work, we propose general post-processing algorithms for individual fairness (IF). We consider a setting where the learner only has access to the predictions of the original model and a similarity graph between individuals, guiding the desired fairness constraints. We cast the IF post-processing problem as a graph smoothing problem corresponding to graph Laplacian regularization that preserves the desired "treat similar individuals similarly" interpretation. Our theoretical results demonstrate the connection of the new objective function to a local relaxation of the original individual fairness. Empirically, our post-processing algorithms correct individual biases in large-scale NLP models such as BERT, while preserving accuracy.

📄 PDF Abstract BibTeX arXiv:2110.13796

Code (1)

felix-petersen/fairness-post-processing 공식 구현 pytorch

Tasks

Fairness

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
WordPiece 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

Bias Mitigation Post-processing for Individual and Group Fairness

2018-12-14 · Pranay K. Lohia, Karthikeyan Natesan Ramamurthy, Manish Bhide, Diptikalyan Saha 외

Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel f…

FairnessGeneral Classification

On the (In)Compatibility between Group Fairness and Individual Fairness

2024-01-13 · Shizhou Xu, Thomas Strohmer

We study the compatibility between the optimal statistical parity solutions and individual fairness. While individual fairness seeks to treat similar individuals similarly, optimal statistical parity aims to provide simi…

Fairness

Priority-based Post-Processing Bias Mitigation for Individual and Group Fairness

2021-01-31 · Pranay Lohia

Previous post-processing bias mitigation algorithms on both group and individual fairness don't work on regression models and datasets with multi-class numerical labels. We propose a priority-based post-processing bias m…

Fairness

Biased Models Have Biased Explanations

2020-12-20 · Aditya Jain, Manish Ravula, Joydeep Ghosh

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we firs…

AttributeBIG-bench Machine LearningFairness

Post-processing of Differentially Private Data: A Fairness Perspective

2022-01-24 · Keyu Zhu, Ferdinando Fioretto, Pascal Van Hentenryck

Post-processing immunity is a fundamental property of differential privacy: it enables arbitrary data-independent transformations to differentially private outputs without affecting their privacy guarantees. Post-process…

Fairness