Pointer-based Fusion of Bilingual Lexicons into Neural Machine Translation
Neural machine translation (NMT) systems require large amounts of high quality in-domain parallel corpora for training. State-of-the-art NMT systems still face challenges related to out-of-vocabulary words and dealing with low-resource language pairs. In this paper, we propose and compare several models for fusion of bilingual lexicons with an end-to-end trained sequence-to-sequence model for machine translation. The result is a fusion model with two information sources for the decoder: a neural conditional language model and a bilingual lexicon. This fusion model learns how to combine both sources of information in order to produce higher quality translation output. Our experiments show that our proposed models work well in relatively low-resource scenarios, and also effectively reduce the parameter size and training cost for NMT without sacrificing performance.
Code (1)
Tasks
DecoderLanguage ModelingLanguage ModellingMachine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
HABLex: Human Annotated Bilingual Lexicons for Experiments in Machine Translation
Bilingual lexicons are valuable resources used by professional human translators. While these resources can be easily incorporated in statistical machine translation, it is unclear how to best do so in the neural framewo…
Machine TranslationTranslationDiscovering Bilingual Lexicons in Polyglot Word Embeddings
Bilingual lexicons and phrase tables are critical resources for modern Machine Translation systems. Although recent results show that without any seed lexicon or parallel data, highly accurate bilingual lexicons can be l…
Machine TranslationTranslationWord EmbeddingsBuilding Multiword Expressions Bilingual Lexicons for Domain Adaptation of an Example-Based Machine Translation System
We describe in this paper a hybrid ap-proach to build automatically bilingual lexicons of Multiword Expressions (MWEs) from parallel corpora. We more specifically investigate the impact of using a domain-specific bilingu…
Domain AdaptationInformation RetrievalMachine TranslationTranslationLexC-Gen: Generating Data for Extremely Low-Resource Languages with Large Language Models and Bilingual Lexicons
Data scarcity in low-resource languages can be addressed with word-to-word translations from labeled task data in high-resource languages using bilingual lexicons. However, bilingual lexicons often have limited lexical o…
Sentiment AnalysisTopic ClassificationTranslationWord TranslationPoint, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation
This paper proposes a sophisticated neural architecture to incorporate bilingual dictionaries into Neural Machine Translation (NMT) models. By introducing three novel components: Pointer, Disambiguator, and Copier, our m…
Machine TranslationNMTTranslation