Optimizing fairness tradeoffs in machine learning with multiobjective meta-models
Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a single objective problem with a parameter controlling the relative importance of error versus fairness. We propose instead to directly optimize the error-fairness tradeoff by using multi-objective optimization. We present a flexible framework for defining the fair machine learning task as a weighted classification problem with multiple cost functions. This framework is agnostic to the underlying prediction model as well as the metrics. We use multiobjective optimization to define the sample weights used in model training for a given machine learner, and adapt the weights to optimize multiple metrics of fairness and accuracy across a set of tasks. To reduce the number of optimized parameters, and to constrain their complexity with respect to population subgroups, we propose a novel meta-model approach that learns to map protected attributes to sample weights, rather than optimizing those weights directly. On a set of real-world problems, this approach outperforms current state-of-the-art methods by finding solution sets with preferable error/fairness trade-offs.
Code (1)
Tasks
FairnessMultiobjective OptimizationSimilar Papers 제목 키워드 기반
LibMOON: A Gradient-based MultiObjective OptimizatioN Library in PyTorch
Multiobjective optimization problems (MOPs) are prevalent in machine learning, with applications in multi-task learning, learning under fairness or robustness constraints, etc. Instead of reducing multiple objective func…
Evolutionary AlgorithmsFairnessMultiobjective OptimizationMulti-Task LearningThe fairness-accuracy landscape of neural classifiers
That machine learning algorithms can demonstrate bias is well-documented by now. This work confronts the challenge of bias mitigation in feedforward fully-connected neural nets from the lens of causal inference and multi…
AttributeCausal InferenceFairnessConsider the Alternatives: Navigating Fairness-Accuracy Tradeoffs via Disqualification
In many machine learning settings there is an inherent tension between fairness and accuracy desiderata. How should one proceed in light of such trade-offs? In this work we introduce and study $\gamma$-disqualification, …
FairnessMachine Learning Fairness in Justice Systems: Base Rates, False Positives, and False Negatives
Machine learning best practice statements have proliferated, but there is a lack of consensus on what the standards should be. For fairness standards in particular, there is little guidance on how fairness might be achie…
BIG-bench Machine LearningFairnessExamining the Interplay Between Privacy and Fairness for Speech Processing: A Review and Perspective
Speech technology has been increasingly deployed in various areas of daily life including sensitive domains such as healthcare and law enforcement. For these technologies to be effective, they must work reliably for all …
Fairness