Navigating Ensemble Configurations for Algorithmic Fairness
Bias mitigators can improve algorithmic fairness in machine learning models, but their effect on fairness is often not stable across data splits. A popular approach to train more stable models is ensemble learning, but unfortunately, it is unclear how to combine ensembles with mitigators to best navigate trade-offs between fairness and predictive performance. To that end, we built an open-source library enabling the modular composition of 8 mitigators, 4 ensembles, and their corresponding hyperparameters, and we empirically explored the space of configurations on 13 datasets. We distilled our insights from this exploration in the form of a guidance diagram for practitioners that we demonstrate is robust and reproducible.
Code (0)
등록된 구현이 없습니다.
Tasks
Ensemble LearningFairnessNavigateMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The Disparate Benefits of Deep Ensembles
Ensembles of Deep Neural Networks, Deep Ensembles, are widely used as a simple way to boost predictive performance. However, their impact on algorithmic fairness is not well understood yet. Algorithmic fairness investiga…
DiversityFairnessOn Fairness, Diversity and Randomness in Algorithmic Decision Making
Consider a binary decision making process where a single machine learning classifier replaces a multitude of humans. We raise questions about the resulting loss of diversity in the decision making process. We study the p…
Decision MakingDiversityFairnessTowards Understanding Fairness and its Composition in Ensemble Machine Learning
Machine Learning (ML) software has been widely adopted in modern society, with reported fairness implications for minority groups based on race, sex, age, etc. Many recent works have proposed methods to measure and mitig…
FairnessFairAIED: Navigating Fairness, Bias, and Ethics in Educational AI Applications
The integration of Artificial Intelligence (AI) into education has transformative potential, providing tailored learning experiences and creative instructional approaches. However, the inherent biases in AI algorithms hi…
EthicsFairnessSurveyVisual Model Selection using Feature Importance Clusters in Fairness-Performance Similarity Optimized Space
In the context of algorithmic decision-making, fair machine learning methods often yield multiple models that balance predictive fairness and performance in varying degrees. This diversity introduces a challenge for stak…
Feature ImportanceMetric Learning