Improving Context-aware Neural Machine Translation with Target-side Context
In recent years, several studies on neural machine translation (NMT) have attempted to use document-level context by using a multi-encoder and two attention mechanisms to read the current and previous sentences to incorporate the context of the previous sentences. These studies concluded that the target-side context is less useful than the source-side context. However, we considered that the reason why the target-side context is less useful lies in the architecture used to model these contexts. Therefore, in this study, we investigate how the target-side context can improve context-aware neural machine translation. We propose a weight sharing method wherein NMT saves decoder states and calculates an attention vector using the saved states when translating a current sentence. Our experiments show that the target-side context is also useful if we plug it into NMT as the decoder state when translating a previous sentence.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderMachine TranslationNMTSentenceTranslationSimilar Papers 제목 키워드 기반
Context-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model
Although many context-aware neural machine translation models have been proposed to incorporate contexts in translation, most of those models are trained end-to-end on parallel documents aligned in sentence-level. Becaus…
DecoderLanguage ModelingLanguage ModellingMachine Translation+2Promoting Target Data in Context-aware Neural Machine Translation
Standard context-aware neural machine translation (NMT) typically relies on parallel document-level data, exploiting both source and target contexts. Concatenation-based approaches in particular, still a strong baseline …
Machine TranslationNMTTranslationRevisiting Context Choices for Context-aware Machine Translation
One of the most popular methods for context-aware machine translation (MT) is to use separate encoders for the source sentence and context as multiple sources for one target sentence. Recent work has cast doubt on whethe…
Machine TranslationSentenceTranslationTANDO: A Corpus for Document-level Machine Translation
Document-level Neural Machine Translation aims to increase the quality of neural translation models by taking into account contextual information. Properly modelling information beyond the sentence level can result in im…
Document Level Machine TranslationMachine TranslationSentenceTranslationTarget-Agnostic Gender-Aware Contrastive Learning for Mitigating Bias in Multilingual Machine Translation
Gender bias is a significant issue in machine translation, leading to ongoing research efforts in developing bias mitigation techniques. However, most works focus on debiasing bilingual models without much consideration …
Contrastive LearningMachine TranslationTranslation