Continuous Learning in Neural Machine Translation using Bilingual Dictionaries
While recent advances in deep learning led to significant improvements in machine translation, neural machine translation is often still not able to continuously adapt to the environment. For humans, as well as for machine translation, bilingual dictionaries are a promising knowledge source to continuously integrate new knowledge. However, their exploitation poses several challenges: The system needs to be able to perform one-shot learning as well as model the morphology of source and target language. In this work, we proposed an evaluation framework to assess the ability of neural machine translation to continuously learn new phrases. We integrate one-shot learning methods for neural machine translation with different word representations and show that it is important to address both in order to successfully make use of bilingual dictionaries. By addressing both challenges we are able to improve the ability to translate new, rare words and phrases from 30% to up to 70%. The correct lemma is even generated by more than 90%.
Code (0)
등록된 구현이 없습니다.
Tasks
LEMMAMachine TranslationOne-Shot LearningTranslationSimilar Papers 제목 키워드 기반
Bridging Neural Machine Translation and Bilingual Dictionaries
Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarel…
Machine TranslationNMTSentenceTranslationLook It Up: Bilingual Dictionaries Improve Neural Machine Translation
Despite advances in neural machine translation (NMT) quality, rare words continue to be problematic. For humans, the solution to the rare-word problem has long been dictionaries, but dictionaries cannot be straightforwar…
Machine TranslationNMTTranslationIncorporating Bilingual Dictionaries for Low Resource Semi-Supervised Neural Machine Translation
We explore ways of incorporating bilingual dictionaries to enable semi-supervised neural machine translation. Conventional back-translation methods have shown success in leveraging target side monolingual data. However, …
Data AugmentationMachine TranslationTranslationDict-NMT: Bilingual Dictionary based NMT for Extremely Low Resource Languages
Neural Machine Translation (NMT) models have been effective on large bilingual datasets. However, the existing methods and techniques show that the model's performance is highly dependent on the number of examples in tra…
Machine TranslationNMTTranslationCreating rich online dictionaries for the Lao--French language pair, reusable for Machine Translation
In this paper, we present how we generated two rich online bilingual dictionaries {---} Lao-French and French-Lao {---} from unstructured dictionaries in Microsoft Word files. Then we shortly discuss the possible reuse o…
Machine TranslationTranslation