paper-with-me

Papers

How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis

2022-06-01 · Bishwamittra Ghosh, Debabrota Basu, Kuldeep S. Meel

Fairness in machine learning has attained significant focus due to the widespread application in high-stake decision-making tasks. Unregulated machine learning classifiers can exhibit bias towards certain demographic groups in data, thus the quantification and mitigation of classifier bias is a central concern in fairness in machine learning. In this paper, we aim to quantify the influence of different features in a dataset on the bias of a classifier. To do this, we introduce the Fairness Influence Function (FIF). This function breaks down bias into its components among individual features and the intersection of multiple features. The key idea is to represent existing group fairness metrics as the difference of the scaled conditional variances in the classifier's prediction and apply a decomposition of variance according to global sensitivity analysis. To estimate FIFs, we instantiate an algorithm FairXplainer that applies variance decomposition of classifier's prediction following local regression. Experiments demonstrate that FairXplainer captures FIFs of individual feature and intersectional features, provides a better approximation of bias based on FIFs, demonstrates higher correlation of FIFs with fairness interventions, and detects changes in bias due to fairness affirmative/punitive actions in the classifier. The code is available at https://github.com/ReAILe/bias-explainer.

📄 PDF Abstract BibTeX arXiv:2206.00667

Code (1)

reaile/bias-explainer 공식 구현

Tasks

BIG-bench Machine LearningDecision MakingFairnessSensitivity

Similar Papers 제목 키워드 기반

Fairness Shields: Safeguarding against Biased Decision Makers

2024-12-16 · Filip Cano, Thomas A. Henzinger, Bettina Könighofer, Konstantin Kueffner 외

As AI-based decision-makers increasingly influence human lives, it is a growing concern that their decisions are often unfair or biased with respect to people's sensitive attributes, such as gender and race. Most existin…

Fairness

Fairness Explainability using Optimal Transport with Applications in Image Classification

2023-08-22 · Philipp Ratz, François Hu, Arthur Charpentier

Ensuring trust and accountability in Artificial Intelligence systems demands explainability of its outcomes. Despite significant progress in Explainable AI, human biases still taint a substantial portion of its training …

Decision MakingFairnessimage-classificationImage Classification

Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds

2020-04-26 · ACL 2020 6 · Kawin Ethayarajh

Most NLP datasets are not annotated with protected attributes such as gender, making it difficult to measure classification bias using standard measures of fairness (e.g., equal opportunity). However, manually annotating…

AttributeFairness

Path-Specific Counterfactual Fairness for Recommender Systems

2023-06-05 · Yaochen Zhu, Jing Ma, Liang Wu, Qi Guo 외

Recommender systems (RSs) have become an indispensable part of online platforms. With the growing concerns of algorithmic fairness, RSs are not only expected to deliver high-quality personalized content, but are also dem…

BlockingcounterfactualCounterfactual InferenceFairness+2

Public Perceptions of Fairness Metrics Across Borders

2024-03-24 · Yuya Sasaki, Sohei Tokuno, Haruka Maeda, Kazuki Nakajima 외

Which fairness metrics are appropriately applicable in your contexts? There may be instances of discordance regarding the perception of fairness, even when the outcomes comply with established fairness metrics. Several q…

Decision MakingFairnessSurvey