Document-Level Neural Machine Translation with Hierarchical Attention Networks
Neural Machine Translation (NMT) can be improved by including document-level contextual information. For this purpose, we propose a hierarchical attention model to capture the context in a structured and dynamic manner. The model is integrated in the original NMT architecture as another level of abstraction, conditioning on the NMT model's own previous hidden states. Experiments show that hierarchical attention significantly improves the BLEU score over a strong NMT baseline with the state-of-the-art in context-aware methods, and that both the encoder and decoder benefit from context in complementary ways.
Code (2)
Tasks
DecoderMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Hierarchical Learning for Generation with Long Source Sequences
One of the challenges for current sequence to sequence (seq2seq) models is processing long sequences, such as those in summarization and document level machine translation tasks. These tasks require the model to reason a…
DecoderDocument Level Machine TranslationDocument SummarizationDocument Translation+6Hierarchical Modeling of Global Context for Document-Level Neural Machine Translation
Document-level machine translation (MT) remains challenging due to the difficulty in efficiently using document context for translation. In this paper, we propose a hierarchical model to learn the global context for docu…
Document Level Machine TranslationMachine TranslationNMTSentence+1Hie-BART: Document Summarization with Hierarchical BART
This paper proposes a new abstractive document summarization model, hierarchical BART (Hie-BART), which captures hierarchical structures of a document (i.e., sentence-word structures) in the BART model. Although the exis…
Document SummarizationMachine TranslationSentenceTranslationDocument Level NMT of Low-Resource Languages with Backtranslation
This paper describes our system submission to WMT20 shared task on similar language translation. We examined the use of documentlevel neural machine translation (NMT) systems for low-resource, similar language pair Marat…
Machine TranslationNMTSentenceTranslationModeling Discourse Structure for Document-level Neural Machine Translation
Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the i…
Machine TranslationNMTTranslation