Blackbox Post-Processing for Multiclass Fairness
Applying standard machine learning approaches for classification can produce unequal results across different demographic groups. When then used in real-world settings, these inequities can have negative societal impacts. This has motivated the development of various approaches to fair classification with machine learning models in recent years. In this paper, we consider the problem of modifying the predictions of a blackbox machine learning classifier in order to achieve fairness in a multiclass setting. To accomplish this, we extend the 'post-processing' approach in Hardt et al. 2016, which focuses on fairness for binary classification, to the setting of fair multiclass classification. We explore when our approach produces both fair and accurate predictions through systematic synthetic experiments and also evaluate discrimination-fairness tradeoffs on several publicly available real-world application datasets. We find that overall, our approach produces minor drops in accuracy and enforces fairness when the number of individuals in the dataset is high relative to the number of classes and protected groups.
Code (1)
Tasks
BIG-bench Machine LearningBinary ClassificationClassificationFairnessSimilar Papers 제목 키워드 기반
Imposing Consistency Properties on Blackbox Systems with Applications to SVD-Based Recommender Systems
In this paper we discuss pre- and post-processing methods to induce desired consistency and/or invariance properties in blackbox systems, e.g., AI-based. We demonstrate our approach in the context of blackbox SVD-based m…
FairnessMatrix CompletionRecommendation SystemsA Unified Post-Processing Framework for Group Fairness in Classification
We present a post-processing algorithm for fair classification that covers group fairness criteria including statistical parity, equal opportunity, and equalized odds under a single framework, and is applicable to multic…
AttributeFairnessExploring Text Specific and Blackbox Fairness Algorithms in Multimodal Clinical NLP
Clinical machine learning is increasingly multimodal, collected in both structured tabular formats and unstructured forms such as freetext. We propose a novel task of exploring fairness on a multimodal clinical dataset, …
FairnessWord EmbeddingsOptimal Fair Aggregation of Crowdsourced Noisy Labels using Demographic Parity Constraints
As acquiring reliable ground-truth labels is usually costly, or infeasible, crowdsourcing and aggregation of noisy human annotations is the typical resort. Aggregating subjective labels, though, may amplify individual bi…
The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanations
Machine learning models in safety-critical settings like healthcare are often blackboxes: they contain a large number of parameters which are not transparent to users. Post-hoc explainability methods where a simple, huma…
BIG-bench Machine LearningFairness