Document Context Neural Machine Translation with Memory Networks
We present a document-level neural machine translation model which takes both source and target document context into account using memory networks. We model the problem as a structured prediction problem with interdependencies among the observed and hidden variables, i.e., the source sentences and their unobserved target translations in the document. The resulting structured prediction problem is tackled with a neural translation model equipped with two memory components, one each for the source and target side, to capture the documental interdependencies. We train the model end-to-end, and propose an iterative decoding algorithm based on block coordinate descent. Experimental results of English translations from French, German, and Estonian documents show that our model is effective in exploiting both source and target document context, and statistically significantly outperforms the previous work in terms of BLEU and METEOR.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationStructured PredictionTranslationSimilar Papers 제목 키워드 기반
SMDT: Selective Memory-Augmented Neural Document Translation
Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more divers…
Document Level Machine TranslationDocument TranslationMachine TranslationNMT+2Document-level Neural Machine Translation with Associated Memory Network
Standard neural machine translation (NMT) is on the assumption that the document-level context is independent. Most existing document-level NMT approaches are satisfied with a smattering sense of global document-level in…
Machine TranslationNMTSentenceTranslationLearn To Remember: Transformer with Recurrent Memory for Document-Level Machine Translation
The Transformer architecture has led to significant gains in machine translation. However, most studies focus on only sentence-level translation without considering the context dependency within documents, leading to the…
Document Level Machine TranslationMachine TranslationSentenceTranslationImproving Long Context Document-Level Machine Translation
Document-level context for neural machine translation (NMT) is crucial to improve the translation consistency and cohesion, the translation of ambiguous inputs, as well as several other linguistic phenomena. Many works h…
Document Level Machine TranslationMachine TranslationNMTSentence+1Locality-Sensitive Hashing for Long Context Neural Machine Translation
After its introduction the Transformer architecture quickly became the gold standard for the task of neural machine translation. A major advantage of the Transformer compared to previous architectures is the faster train…
Document Level Machine TranslationMachine TranslationNMTSentence+1