Does Robustness Improve Fairness? Approaching Fairness with Word Substitution Robustness Methods for Text Classification
Existing bias mitigation methods to reduce disparities in model outcomes across cohorts have focused on data augmentation, debiasing model embeddings, or adding fairness-based optimization objectives during training. Separately, certified word substitution robustness methods have been developed to decrease the impact of spurious features and synonym substitutions on model predictions. While their end goals are different, they both aim to encourage models to make the same prediction for certain changes in the input. In this paper, we investigate the utility of certified word substitution robustness methods to improve equality of odds and equality of opportunity on multiple text classification tasks. We observe that certified robustness methods improve fairness, and using both robustness and bias mitigation methods in training results in an improvement in both fronts
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationFairnesstext-classificationText ClassificationSimilar Papers 제목 키워드 기반
How Robust is your Fair Model? Exploring the Robustness of Diverse Fairness Strategies
With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairnes…
Decision MakingFairnessUnfairness DetectionH-nobs: Achieving Certified Fairness and Robustness in Distributed Learning on Heterogeneous Datasets
Fairness and robustness are two important goals in the design of modern distributed learning systems. Despite a few prior works attempting to achieve both fairness and robustness, some key aspects of this direction remai…
AI Fairness for People with Disabilities: Point of View
We consider how fair treatment in society for people with disabilities might be impacted by the rise in the use of artificial intelligence, and especially machine learning methods. We argue that fairness for people with …
DiversityFairnessTo be Robust and to be Fair: Aligning Fairness with Robustness
Adversarial training has been shown to be reliable in improving robustness against adversarial samples. However, the problem of adversarial training in terms of fairness has not yet been properly studied, and the relatio…
Adversarial AttackFairnessTier Balancing: Towards Dynamic Fairness over Underlying Causal Factors
The pursuit of long-term fairness involves the interplay between decision-making and the underlying data generating process. In this paper, through causal modeling with a directed acyclic graph (DAG) on the decision-dist…
Decision MakingFairness