Exploiting Cross-Sentence Context for Neural Machine Translation
In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on the performance of neural machine translation (NMT). First, this history is summarized in a hierarchical way. We then integrate the historical representation into NMT in two strategies: 1) a warm-start of encoder and decoder states, and 2) an auxiliary context source for updating decoder states. Experimental results on a large Chinese-English translation task show that our approach significantly improves upon a strong attention-based NMT system by up to +2.1 BLEU points.
Code (1)
Tasks
DecoderMachine TranslationNMTSentenceTranslationSimilar Papers 제목 키워드 기반
Non-Autoregressive Document-Level Machine Translation
Non-autoregressive translation (NAT) models achieve comparable performance and superior speed compared to auto-regressive translation (AT) models in the context of sentence-level machine translation (MT). However, their …
Document Level Machine TranslationMachine TranslationSentenceText Generation+1Evaluating Discourse Phenomena in Neural Machine Translation
For machine translation to tackle discourse phenomena, models must have access to extra-sentential linguistic context. There has been recent interest in modelling context in neural machine translation (NMT), but models h…
Machine TranslationNMTSentenceTranslationLearning Contextualized Sentence Representations for Document-Level Neural Machine Translation
Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural m…
Document Level Machine TranslationMachine TranslationNMTSentence+2Promoting Target Data in Context-aware Neural Machine Translation
Standard context-aware neural machine translation (NMT) typically relies on parallel document-level data, exploiting both source and target contexts. Concatenation-based approaches in particular, still a strong baseline …
Machine TranslationNMTTranslationContext-aware Neural Machine Translation with Mini-batch Embedding
It is crucial to provide an inter-sentence context in Neural Machine Translation (NMT) models for higher-quality translation. With the aim of using a simple approach to incorporate inter-sentence information, we propose …
Machine TranslationNMTSentenceTranslation