paper-with-me

Papers

Exploring the Linear Subspace Hypothesis in Gender Bias Mitigation

2020-09-20 · EMNLP 2020 11 · Francisco Vargas, Ryan Cotterell

Bolukbasi et al. (2016) presents one of the first gender bias mitigation techniques for word representations. Their method takes pre-trained word representations as input and attempts to isolate a linear subspace that captures most of the gender bias in the representations. As judged by an analogical evaluation task, their method virtually eliminates gender bias in the representations. However, an implicit and untested assumption of their method is that the bias subspace is actually linear. In this work, we generalize their method to a kernelized, nonlinear version. We take inspiration from kernel principal component analysis and derive a nonlinear bias isolation technique. We discuss and overcome some of the practical drawbacks of our method for non-linear gender bias mitigation in word representations and analyze empirically whether the bias subspace is actually linear. Our analysis shows that gender bias is in fact well captured by a linear subspace, justifying the assumption of Bolukbasi et al. (2016).

📄 PDF Abstract BibTeX arXiv:2009.09435

Code (1)

franciscovargas/Bias_space_study 공식 구현

Tasks

Word Embeddings

Similar Papers 제목 키워드 기반

Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations

2020-12-01 · COLING 2020 8 · Sheng Liang, Philipp Dufter, Hinrich Sch{\"u}tze

Pretrained language models (PLMs) learn stereotypes held by humans and reflected in text from their training corpora, including gender bias. When PLMs are used for downstream tasks such as picking candidates for a job, p…

Language ModelingLanguage ModellingSentence

What Does Debiasing Really Remove? A Geometric Study of PCA-Based Gender Debiasing in Word Embeddings

2026-06-06 · Alexey Kresin, Tchifou M. Dieffi, Tomer Caspi arxiv

Debiasing methods based on principal component analysis (PCA) are broadly used to reduce gender bias in word embeddings used in LLMs, yet it remains unclear what aspects of bias they actually remove and how destructive t…

Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation

2020-05-03 · ACL 2020 6 · Tianlu Wang, Xi Victoria Lin, Nazneen Fatema Rajani, Bryan McCann 외

Word embeddings derived from human-generated corpora inherit strong gender bias which can be further amplified by downstream models. Some commonly adopted debiasing approaches, including the seminal Hard Debias algorithm…

Word Embeddings

It's All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution

2019-09-02 · IJCNLP 2019 11 · Rowan Hall Maudslay, Hila Gonen, Ryan Cotterell, Simone Teufel

This paper treats gender bias latent in word embeddings. Previous mitigation attempts rely on the operationalisation of gender bias as a projection over a linear subspace. An alternative approach is Counterfactual Data A…

AllcounterfactualData AugmentationWord Embeddings

Neutralizing Gender Bias in Word Embeddings with Latent Disentanglement and Counterfactual Generation

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Seungjae Shin, Kyungwoo Song, JoonHo Jang, Hyemi Kim 외

Recent research demonstrates that word embeddings, trained on the human-generated corpus, have strong gender biases in embedding spaces, and these biases can result in the discriminative results from the various downstre…

counterfactualDisentanglementWord Embeddings