paper-with-me

홈 › Papers

Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques

2019-01-10 · Joel Escudé Font, Marta R. Costa-jussà

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which contain biases and stereotypes. As a consequence, models inherit these social biases. Recent methods have shown results in reducing gender bias in other natural language processing tools such as word embeddings. We take advantage of the fact that word embeddings are used in neural machine translation to propose a method to equalize gender biases in neural machine translation using these representations. Specifically, we propose, experiment and analyze the integration of two debiasing techniques over GloVe embeddings in the Transformer translation architecture. We evaluate our proposed system on the WMT English-Spanish benchmark task, showing gains up to one BLEU point. As for the gender bias evaluation, we generate a test set of occupations and we show that our proposed system learns to equalize existing biases from the baseline system.

📄 PDF Abstract BibTeX arXiv:1901.03116

Code (1)

joelescudefont/genbiasmt 공식 구현

Tasks

FairnessMachine TranslationTranslationWord Embeddings

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Equalizing Gender Bias in Neural Machine Translation with Word Embeddings Techniques

2019-08-01 · WS 2019 8 · Joel Escud{\'e} Font, Marta R. Costa-juss{\`a}

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large t…

FairnessMachine TranslationTranslationWord Embeddings

Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddings

2020-05-18 · Katherine McCurdy, Oguz Serbetci

Recent research has demonstrated that vector space models of semantics can reflect undesirable biases in human culture. Our investigation of crosslinguistic word embeddings reveals that topical gender bias interacts with…

Cultural Vocal Bursts Intensity PredictionLemmatizationMachine TranslationTranslation+1

GOSt-MT: A Knowledge Graph for Occupation-related Gender Biases in Machine Translation

2024-09-17 · Orfeas Menis Mastromichalakis, Giorgos Filandrianos, Eva Tsouparopoulou, Dimitris Parsanoglou 외

Gender bias in machine translation (MT) systems poses significant challenges that often result in the reinforcement of harmful stereotypes. Especially in the labour domain where frequently occupations are inaccurately as…

Machine TranslationTranslation

Measuring and Mitigating Name Biases in Neural Machine Translation

2022-05-01 · ACL 2022 5 · Jun Wang, Benjamin Rubinstein, Trevor Cohn

Neural Machine Translation (NMT) systems exhibit problematic biases, such as stereotypical gender bias in the translation of occupation terms into languages with grammatical gender. In this paper we describe a new source…

Data AugmentationMachine TranslationNMTTranslation

How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts

2022-05-22 · Shanya Sharma, Manan Dey, Koustuv Sinha

Neural Machine Translation systems built on top of Transformer-based architectures are routinely improving the state-of-the-art in translation quality according to word-overlap metrics. However, a growing number of studi…

Bias DetectionMachine TranslationTranslation