paper-with-me

홈 › Papers

Equalizing Gender Bias in Neural Machine Translation with Word Embeddings Techniques

2019-08-01 · WS 2019 8 · Joel Escud{\'e} Font, Marta R. Costa-juss{\`a}

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which contain biases and stereotypes. As a consequence, models inherit these social biases. Recent methods have shown results in reducing gender bias in other natural language processing tools such as word embeddings. We take advantage of the fact that word embeddings are used in neural machine translation to propose a method to equalize gender biases in neural machine translation using these representations. Specifically, we propose, experiment and analyze the integration of two debiasing techniques over GloVe embeddings in the Transformer translation architecture. We evaluate our proposed system on the WMT English-Spanish benchmark task, showing gains up to one BLEU point. As for the gender bias evaluation, we generate a test set of occupations and we show that our proposed system learns to equalize existing biases from the baseline system.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessMachine TranslationTranslationWord Embeddings

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques

2019-01-10 · Joel Escudé Font, Marta R. Costa-jussà

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large t…

FairnessMachine TranslationTranslationWord Embeddings

Reducing Gender Bias in Word-Level Language Models with a Gender-Equalizing Loss Function

2019-05-30 · ACL 2019 7 · Yusu Qian, Urwa Muaz, Ben Zhang, Jae Won Hyun

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. …

Data AugmentationText Generation

Beyond Binary Gender: Evaluating Gender-Inclusive Machine Translation with Ambiguous Attitude Words

2024-07-23 · Yijie Chen, Yijin Liu, Fandong Meng, Jinan Xu 외

Gender bias has been a focal point in the study of bias in machine translation and language models. Existing machine translation gender bias evaluations are primarily focused on male and female genders, limiting the scop…

Machine TranslationTranslation

Gender bias Evaluation in Luganda-English Machine Translation

2022-09-01 · AMTA 2022 9 · Eric Peter Wairagala

We have seen significant growth in the area of building Natural Language Processing (NLP) tools for African languages. However, the evaluation of gender bias in the machine translation systems for African languages is no…

Embeddings EvaluationFairnessMachine TranslationTransfer Learning+2

Exploring the Impact of Training Data Distribution and Subword Tokenization on Gender Bias in Machine Translation

2023-09-21 · Bar Iluz, Tomasz Limisiewicz, Gabriel Stanovsky, David Mareček

We study the effect of tokenization on gender bias in machine translation, an aspect that has been largely overlooked in previous works. Specifically, we focus on the interactions between the frequency of gendered profes…

Gender PredictionMachine TranslationTranslation