MABR: Multilayer Adversarial Bias Removal Without Prior Bias Knowledge
Models trained on real-world data often mirror and exacerbate existing social biases. Traditional methods for mitigating these biases typically require prior knowledge of the specific biases to be addressed, such as gender or racial biases, and the social groups associated with each instance. In this paper, we introduce a novel adversarial training strategy that operates independently of prior bias-type knowledge and protected attribute labels. Our approach proactively identifies biases during model training by utilizing auxiliary models, which are trained concurrently by predicting the performance of the main model without relying on task labels. Additionally, we implement these auxiliary models at various levels of the feature maps of the main model, enabling the detection of a broader and more nuanced range of bias features. Through experiments on racial and gender biases in sentiment and occupation classification tasks, our method effectively reduces social biases without the need for demographic annotations. Moreover, our approach not only matches but often surpasses the efficacy of methods that require detailed demographic insights, marking a significant advancement in bias mitigation techniques.
Code (1)
Tasks
AttributeSimilar Papers 제목 키워드 기반
Robsut Wrod Reocginiton via semi-Character Recurrent Neural Network
Language processing mechanism by humans is generally more robust than computers. The Cmabrigde Uinervtisy (Cambridge University) effect from the psycholinguistics literature has demonstrated such a robust word processing…
Spelling CorrectionMulti-Agent Broad Reinforcement Learning for Intelligent Traffic Light Control
Intelligent Traffic Light Control System (ITLCS) is a typical Multi-Agent System (MAS), which comprises multiple roads and traffic lights.Constructing a model of MAS for ITLCS is the basis to alleviate traffic congestion…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)On Adversarial Removal of Hypothesis-only Bias in Natural Language Inference
Popular Natural Language Inference (NLI) datasets have been shown to be tainted by hypothesis-only biases. Adversarial learning may help models ignore sensitive biases and spurious correlations in data. We evaluate wheth…
Natural Language InferenceUsing Adversarial Debiasing to Remove Bias from Word Embeddings
Word Embeddings have been shown to contain the societal biases present in the original corpora. Existing methods to deal with this problem have been shown to only remove superficial biases. The method of Adversarial Debi…
Word EmbeddingsSABAF: Removing Strong Attribute Bias from Neural Networks with Adversarial Filtering
Ensuring a neural network is not relying on protected attributes (e.g., race, sex, age) for prediction is crucial in advancing fair and trustworthy AI. While several promising methods for removing attribute bias in neura…
Attribute