Context-Aware Learning for Neural Machine Translation
Interest in larger-context neural machine translation, including document-level and multi-modal translation, has been growing. Multiple works have proposed new network architectures or evaluation schemes, but potentially helpful context is still sometimes ignored by larger-context translation models. In this paper, we propose a novel learning algorithm that explicitly encourages a neural translation model to take into account additional context using a multilevel pair-wise ranking loss. We evaluate the proposed learning algorithm with a transformer-based larger-context translation system on document-level translation. By comparing performance using actual and random contexts, we show that a model trained with the proposed algorithm is more sensitive to the additional context.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Lexically Cohesive Neural Machine Translation with Copy Mechanism
Lexically cohesive translations preserve consistency in word choices in document-level translation. We employ a copy mechanism into a context-aware neural machine translation model to allow copying words from previous tr…
Machine TranslationTranslationContext-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model
Although many context-aware neural machine translation models have been proposed to incorporate contexts in translation, most of those models are trained end-to-end on parallel documents aligned in sentence-level. Becaus…
DecoderLanguage ModelingLanguage ModellingMachine Translation+2Towards Chapter-to-Chapter Context-Aware Literary Translation via Large Language Models
Discourse phenomena in existing document-level translation datasets are sparse, which has been a fundamental obstacle in the development of context-aware machine translation models. Moreover, most existing document-level…
Machine TranslationSentenceTranslationDoes Context Help Mitigate Gender Bias in Neural Machine Translation?
Neural Machine Translation models tend to perpetuate gender bias present in their training data distribution. Context-aware models have been previously suggested as a means to mitigate this type of bias. In this work, we…
Machine TranslationTranslationChallenges in Context-Aware Neural Machine Translation
Context-aware neural machine translation involves leveraging information beyond sentence-level context to resolve inter-sentential discourse dependencies and improve document-level translation quality, and has given rise…
Machine TranslationSentenceTranslation