Document Sub-structure in Neural Machine Translation
Current approaches to machine translation (MT) either translate sentences in isolation, disregarding the context they appear in, or model context at the level of the full document, without a notion of any internal structure the document may have. In this work we consider the fact that documents are rarely homogeneous blocks of text, but rather consist of parts covering different topics. Some documents, such as biographies and encyclopedia entries, have highly predictable, regular structures in which sections are characterised by different topics. We draw inspiration from Louis and Webber (2014) who use this information to improve statistical MT and transfer their proposal into the framework of neural MT. We compare two different methods of including information about the topic of the section within which each sentence is found: one using side constraints and the other using a cache-based model. We create and release the data on which we run our experiments - parallel corpora for three language pairs (Chinese-English, French-English, Bulgarian-English) from Wikipedia biographies, which we extract automatically, preserving the boundaries of sections within the articles.
Code (1)
Tasks
ArticlesMachine TranslationSentenceTranslationSimilar Papers 제목 키워드 기반
Document-level Neural Machine Translation Using Dependency RST Structure
Document-level machine translation (MT) extends the translation unit from the sentence to the whole document. Intuitively, discourse structure can be useful for document-level MT for its helpfulness in long-range depende…
DecoderDocument Level Machine TranslationMachine TranslationNMT+2Modeling Discourse Structure for Document-level Neural Machine Translation
Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the i…
Machine TranslationNMTTranslationDocument Context Neural Machine Translation with Memory Networks
We present a document-level neural machine translation model which takes both source and target document context into account using memory networks. We model the problem as a structured prediction problem with interdepen…
Machine TranslationStructured PredictionTranslationStructure-Preserving Document Translation via Multi-Stage LLM Pipeline: A Case Study in Marathi
Government documents in India are predominantly issued in regional languages such as Marathi, creating substantial accessibility barriers for non-native readers, interstate administrative bodies, and policy analysts. Alt…
Machine TranslationA Parallel Evaluation Data Set of Software Documentation with Document Structure Annotation
This paper accompanies the software documentation data set for machine translation, a parallel evaluation data set of data originating from the SAP Help Portal, that we released to the machine translation community for r…
Machine TranslationTranslation