Standardized Interpretable Fairness Measures for Continuous Risk Scores
We propose a standardized version of fairness measures for continuous scores with a reasonable interpretation based on the Wasserstein distance. Our measures are easily computable and well suited for quantifying and interpreting the strength of group disparities as well as for comparing biases across different models, datasets, or time points. We derive a link between the different families of existing fairness measures for scores and show that the proposed standardized fairness measures outperform ROC-based fairness measures because they are more explicit and can quantify significant biases that ROC-based fairness measures miss.
Code (1)
Tasks
FairnessSimilar Papers 제목 키워드 기반
Marginal Fairness: Fair Decision-Making under Risk Measures
This paper introduces marginal fairness, a new individual fairness notion for equitable decision-making in the presence of protected attributes such as gender, race, and religion. This criterion ensures that decisions ba…
AttributeDecision MakingFairnessIntersectional Fairness via Mixed-Integer Optimization
The deployment of Artificial Intelligence in high-risk domains, such as finance and healthcare, necessitates models that are both fair and transparent. While regulatory frameworks, including the EU's AI Act, mandate bias…
Towards an AI Accountability Policy
We propose establishing an office to oversee AI systems by introducing a tiered system of explainability and benchmarking requirements for commercial AI systems. We examine how complex high-risk technologies have been su…
BenchmarkingFairnessPAC-Bayesian Generalization Guarantees for Fairness on Stochastic and Deterministic Classifiers
Classical PAC generalization bounds on the prediction risk of a classifier are insufficient to provide theoretical guarantees on fairness when the goal is to learn models balancing predictive risk and fairness constraint…
The cost of fairness in classification
We study the problem of learning classifiers with a fairness constraint, with three main contributions towards the goal of quantifying the problem's inherent tradeoffs. First, we relate two existing fairness measures to …
ClassificationFairnessGeneral Classification