Does Neural Machine Translation Benefit from Larger Context?
We propose a neural machine translation architecture that models the surrounding text in addition to the source sentence. These models lead to better performance, both in terms of general translation quality and pronoun prediction, when trained on small corpora, although this improvement largely disappears when trained with a larger corpus. We also discover that attention-based neural machine translation is well suited for pronoun prediction and compares favorably with other approaches that were specifically designed for this task.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationPredictionSentenceTranslationSimilar Papers 제목 키워드 기반
Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation
In encoder-decoder neural models, multiple encoders are in general used to represent the contextual information in addition to the individual sentence. In this paper, we investigate multi-encoder approaches in documentle…
Decoderfr-enMachine TranslationNMT+2Studying The Impact Of Document-level Context On Simultaneous Neural Machine Translation
In a real-time simultaneous translation setting and neural machine translation (NMT) models start generating target language tokens from incomplete source language sentences and making them harder to translate and leadin…
DecoderMachine TranslationNMTSentence+1Context-Aware Learning for Neural Machine Translation
Interest in larger-context neural machine translation, including document-level and multi-modal translation, has been growing. Multiple works have proposed new network architectures or evaluation schemes, but potentially…
Machine TranslationTranslationFill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation
Most neural machine translation systems still translate sentences in isolation. To make further progress, a promising line of research additionally considers the surrounding context in order to provide the model potentia…
Document Level Machine TranslationLanguage ModelingLanguage ModellingMachine Translation+2Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translation
Context-aware machine translation (MT) leverages document-level information, yet it does not consistently outperform sentence-level MT, as contextual signals are unevenly beneficial across sentences. Existing training ob…
Machine Translation