Incorporating Discrete Translation Lexicons into Neural Machine Translation
Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understanding the meaning of the sentence. We propose a method to alleviate this problem by augmenting NMT systems with discrete translation lexicons that efficiently encode translations of these low-frequency words. We describe a method to calculate the lexicon probability of the next word in the translation candidate by using the attention vector of the NMT model to select which source word lexical probabilities the model should focus on. We test two methods to combine this probability with the standard NMT probability: (1) using it as a bias, and (2) linear interpolation. Experiments on two corpora show an improvement of 2.0-2.3 BLEU and 0.13-0.44 NIST score, and faster convergence time.
Code (2)
Tasks
Machine TranslationNMTSentenceTranslationSimilar Papers 제목 키워드 기반
Lexicons and Minimum Risk Training for Neural Machine Translation: NAIST-CMU at WAT2016
This year, the Nara Institute of Science and Technology (NAIST)/Carnegie Mellon University (CMU) submission to the Japanese-English translation track of the 2016 Workshop on Asian Translation was based on attentional neu…
Machine TranslationNMTTranslationSentiment Lexicons for Arabic Social Media
Existing Arabic sentiment lexicons have low coverage―with only a few thousand entries. In this paper, we present several large sentiment lexicons that were automatically generated using two different methods: (1) by us…
Machine TranslationSentenceSentiment AnalysisTranslation+1HABLex: Human Annotated Bilingual Lexicons for Experiments in Machine Translation
Bilingual lexicons are valuable resources used by professional human translators. While these resources can be easily incorporated in statistical machine translation, it is unclear how to best do so in the neural framewo…
Machine TranslationTranslationPointer-based Fusion of Bilingual Lexicons into Neural Machine Translation
Neural machine translation (NMT) systems require large amounts of high quality in-domain parallel corpora for training. State-of-the-art NMT systems still face challenges related to out-of-vocabulary words and dealing wi…
DecoderLanguage ModelingLanguage ModellingMachine Translation+2Acquisition of Translation Lexicons for Historically Unwritten Languages via Bridging Loanwords
With the advent of informal electronic communications such as social media, colloquial languages that were historically unwritten are being written for the first time in heavily code-switched environments. We present a m…
Machine TranslationTranslation