Modeling Discourse Structure for Document-level Neural Machine Translation
Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be translated, which has shown effective in other tasks. In this paper, we propose to improve document-level NMT with the aid of discourse structure information. Our encoder is based on a hierarchical attention network (HAN). Specifically, we first parse the input document to obtain its discourse structure. Then, we introduce a Transformer-based path encoder to embed the discourse structure information of each word. Finally, we combine the discourse structure information with the word embedding before it is fed into the encoder. Experimental results on the English-to-German dataset show that our model can significantly outperform both Transformer and Transformer+HAN.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
G^2C-MT: Graph-Guided Context Selection for Document-Level Machine Translation
Effective document-level machine translation (DocMT) requires capturing long-range discourse dependencies. Recent work has explored retrieval-based and discourse-aware context selection. However, these approaches often l…
Machine TranslationSemantic SimilarityDocument-level Neural Machine Translation Using Dependency RST Structure
Document-level machine translation (MT) extends the translation unit from the sentence to the whole document. Intuitively, discourse structure can be useful for document-level MT for its helpfulness in long-range depende…
DecoderDocument Level Machine TranslationMachine TranslationNMT+2Document-Level Machine Translation with Large Language Models
Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, …
Document Level Machine TranslationMachine TranslationTranslationModeling Document-level Temporal Structures for Building Temporal Dependency Graphs
We propose to leverage news discourse profiling to model document-level temporal structures for building temporal dependency graphs. Our key observation is that the functional roles of sentences used for profiling news d…
Knowledge DistillationSentenceAn End-to-End Document-Level Neural Discourse Parser Exploiting Multi-Granularity Representations
Document-level discourse parsing, in accordance with the Rhetorical Structure Theory (RST), remains notoriously challenging. Challenges include the deep structure of document-level discourse trees, the requirement of sub…
DecoderDiscourse ParsingLanguage ModelingLanguage Modelling