Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning
Document-level neural machine translation has yielded attractive improvements. However, majority of existing methods roughly use all context sentences in a fixed scope. They neglect the fact that different source sentences need different sizes of context. To address this problem, we propose an effective approach to select dynamic context so that the document-level translation model can utilize the more useful selected context sentences to produce better translations. Specifically, we introduce a selection module that is independent of the translation module to score each candidate context sentence. Then, we propose two strategies to explicitly select a variable number of context sentences and feed them into the translation module. We train the two modules end-to-end via reinforcement learning. A novel reward is proposed to encourage the selection and utilization of dynamic context sentences. Experiments demonstrate that our approach can select adaptive context sentences for different source sentences, and significantly improves the performance of document-level translation methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Translationreinforcement-learningReinforcement Learning (RL)SentenceTranslationSimilar Papers 제목 키워드 기반
HanoiT: Enhancing Context-aware Translation via Selective Context
Context-aware neural machine translation aims to use the document-level context to improve translation quality. However, not all words in the context are helpful. The irrelevant or trivial words may bring some noise and …
DecoderDocument Level Machine TranslationMachine TranslationSentence+1G^2C-MT: Graph-Guided Context Selection for Document-Level Machine Translation
Effective document-level machine translation (DocMT) requires capturing long-range discourse dependencies. Recent work has explored retrieval-based and discourse-aware context selection. However, these approaches often l…
Machine TranslationSemantic SimilarityModeling Document-Level Context for Event Detection via Important Context Selection
The task of Event Detection (ED) in Information Extraction aims to recognize and classify trigger words of events in text. The recent progress has featured advanced transformer-based language models (e.g., BERT) as a cri…
Event DetectionRepresentation LearningSentenceSentence SimilarityDocument-Level Neural Machine Translation with Hierarchical Attention Networks
Neural Machine Translation (NMT) can be improved by including document-level contextual information. For this purpose, we propose a hierarchical attention model to capture the context in a structured and dynamic manner. …
DecoderMachine TranslationNMTTranslationA Document-Level Neural Machine Translation Model with Dynamic Caching Guided by Theme-Rheme Information
Research on document-level Neural Machine Translation (NMT) models has attracted increasing attention in recent years. Although the proposed works have proved that the inter-sentence information is helpful for improving …
Machine TranslationNMTSentenceTranslation