paper-with-me

홈 › Papers

Augmenting Neural Machine Translation with Knowledge Graphs

2019-02-23 · Diego Moussallem, Mihael Arčan, Axel-Cyrille Ngonga Ngomo, Paul Buitelaar

While neural networks have been used extensively to make substantial progress in the machine translation task, they are known for being heavily dependent on the availability of large amounts of training data. Recent efforts have tried to alleviate the data sparsity problem by augmenting the training data using different strategies, such as back-translation. Along with the data scarcity, the out-of-vocabulary words, mostly entities and terminological expressions, pose a difficult challenge to Neural Machine Translation systems. In this paper, we hypothesize that knowledge graphs enhance the semantic feature extraction of neural models, thus optimizing the translation of entities and terminological expressions in texts and consequently leading to a better translation quality. We hence investigate two different strategies for incorporating knowledge graphs into neural models without modifying the neural network architectures. We also examine the effectiveness of our augmentation method to recurrent and non-recurrent (self-attentional) neural architectures. Our knowledge graph augmented neural translation model, dubbed KG-NMT, achieves significant and consistent improvements of +3 BLEU, METEOR and chrF3 on average on the newstest datasets between 2014 and 2018 for WMT English-German translation task.

📄 PDF Abstract BibTeX arXiv:1902.08816

Code (1)

dice-group/KG-NMT tf

Tasks

Knowledge GraphsMachine TranslationNMTTranslation

Similar Papers 제목 키워드 기반

Ukrainian-to-English folktale corpus: Parallel corpus creation and augmentation for machine translation in low-resource languages

2024-10-14 · AMTA 2022 9 · Olena Burda-Lassen

Folktales are linguistically very rich and culturally significant in understanding the source language. Historically, only human translation has been used for translating folklore. Therefore, the number of translated tex…

Machine TranslationSentenceTranslation

Augmenting Knowledge Graph Hierarchies Using Neural Transformers

2024-04-11 · Sanat Sharma, Mayank Poddar, Jayant Kumar, Kosta Blank 외

Knowledge graphs are useful tools to organize, recommend and sort data. Hierarchies in knowledge graphs provide significant benefit in improving understanding and compartmentalization of the data within a knowledge graph…

Knowledge Graphs

Lexical Resources for Hindi Marathi MT

2017-03-04 · Sreelekha. S, Pushpak Bhattacharyya

In this paper we describe some ways to utilize various lexical resources to improve the quality of statistical machine translation system. We have augmented the training corpus with various lexical resources such as Indo…

Machine TranslationTranslation

Question Answering over Knowledge Graphs with Neural Machine Translation and Entity Linking

2021-07-06 · Daniel Diomedi, Aidan Hogan

The goal of Question Answering over Knowledge Graphs (KGQA) is to find answers for natural language questions over a knowledge graph. Recent KGQA approaches adopt a neural machine translation (NMT) approach, where the na…

Entity LinkingKnowledge GraphsMachine TranslationNMT+4

Fully Synthetic Data Improves Neural Machine Translation with Knowledge Distillation

2020-12-31 · Alham Fikri Aji, Kenneth Heafield

This paper explores augmenting monolingual data for knowledge distillation in neural machine translation. Source language monolingual text can be incorporated as a forward translation. Interestingly, we find the best way…

Knowledge DistillationMachine TranslationTranslation