Neutralizing Gender Bias in Word Embedding with Latent Disentanglement and Counterfactual Generation
Recent research demonstrates that word embeddings, trained on the human-generated corpus, have strong gender biases in embedding spaces, and these biases can result in the discriminative results from the various downstream tasks. Whereas the previous methods project word embeddings into a linear subspace for debiasing, we introduce a \textit{Latent Disentanglement} method with a siamese auto-encoder structure with an adapted gradient reversal layer. Our structure enables the separation of the semantic latent information and gender latent information of given word into the disjoint latent dimensions. Afterwards, we introduce a \textit{Counterfactual Generation} to convert the gender information of words, so the original and the modified embeddings can produce a gender-neutralized word embedding after geometric alignment regularization, without loss of semantic information. From the various quantitative and qualitative debiasing experiments, our method shows to be better than existing debiasing methods in debiasing word embeddings. In addition, Our method shows the ability to preserve semantic information during debiasing by minimizing the semantic information losses for extrinsic NLP downstream tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualDisentanglementSentiment AnalysisWord EmbeddingsSimilar Papers 제목 키워드 기반
Neutralizing Gender Bias in Word Embeddings with Latent Disentanglement and Counterfactual Generation
Recent research demonstrates that word embeddings, trained on the human-generated corpus, have strong gender biases in embedding spaces, and these biases can result in the discriminative results from the various downstre…
counterfactualDisentanglementWord EmbeddingsSecond Order WinoBias (SoWinoBias) Test Set for Latent Gender Bias Detection in Coreference Resolution
We observe an instance of gender-induced bias in a downstream application, despite the absence of explicit gender words in the test cases. We provide a test set, SoWinoBias, for the purpose of measuring such latent gende…
Bias Detectioncoreference-resolutionCoreference ResolutionGender Bias DetectionA Causal Inference Method for Reducing Gender Bias in Word Embedding Relations
Word embedding has become essential for natural language processing as it boosts empirical performances of various tasks. However, recent research discovers that gender bias is incorporated in neural word embeddings, and…
Causal Inferencecoreference-resolutionCoreference ResolutionSentence+1It's All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution
This paper treats gender bias latent in word embeddings. Previous mitigation attempts rely on the operationalisation of gender bias as a projection over a linear subspace. An alternative approach is Counterfactual Data A…
AllcounterfactualData AugmentationWord EmbeddingsGender-preserving Debiasing for Pre-trained Word Embeddings
Word embeddings learnt from massive text collections have demonstrated significant levels of discriminative biases such as gender, racial or ethnic biases, which in turn bias the down-stream NLP applications that use tho…
Word Embeddings