Counterfactual Fair Opportunity: Measuring Decision Model Fairness with Counterfactual Reasoning
The increasing application of Artificial Intelligence and Machine Learning models poses potential risks of unfair behavior and, in light of recent regulations, has attracted the attention of the research community. Several researchers focused on seeking new fairness definitions or developing approaches to identify biased predictions. However, none try to exploit the counterfactual space to this aim. In that direction, the methodology proposed in this work aims to unveil unfair model behaviors using counterfactual reasoning in the case of fairness under unawareness setting. A counterfactual version of equal opportunity named counterfactual fair opportunity is defined and two novel metrics that analyze the sensitive information of counterfactual samples are introduced. Experimental results on three different datasets show the efficacy of our methodologies and our metrics, disclosing the unfair behavior of classic machine learning and debiasing models.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualCounterfactual ReasoningFairnessMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Equal Opportunity and Affirmative Action via Counterfactual Predictions
Machine learning (ML) can automate decision-making by learning to predict decisions from historical data. However, these predictors may inherit discriminatory policies from past decisions and reproduce unfair decisions. …
counterfactualDecision MakingFairnessFairness Through Counterfactual Utilities
Group fairness definitions such as Demographic Parity and Equal Opportunity make assumptions about the underlying decision-problem that restrict them to classification problems. Prior work has translated these definition…
BIG-bench Machine LearningcounterfactualFairnessreinforcement-learning+2PC-Fairness: A Unified Framework for Measuring Causality-based Fairness
A recent trend of fair machine learning is to define fairness as causality-based notions which concern the causal connection between protected attributes and decisions. However, one common challenge of all causality-base…
counterfactualFairnessCounterfactual Fairness Is Not Demographic Parity, and Other Observations
Blanket statements of equivalence between causal concepts and purely probabilistic concepts should be approached with care. In this short note, I examine a recent claim that counterfactual fairness is equivalent to demog…
counterfactualFairnessCounterfactual Fairness in Text Classification through Robustness
In this paper, we study counterfactual fairness in text classification, which asks the question: How would the prediction change if the sensitive attribute referenced in the example were different? Toxicity classifiers d…
AttributeClassificationcounterfactualFairness+3