Generative Neural Machine Translation
We introduce Generative Neural Machine Translation (GNMT), a latent variable architecture which is designed to model the semantics of the source and target sentences. We modify an encoder-decoder translation model by adding a latent variable as a language agnostic representation which is encouraged to learn the meaning of the sentence. GNMT achieves competitive BLEU scores on pure translation tasks, and is superior when there are missing words in the source sentence. We augment the model to facilitate multilingual translation and semi-supervised learning without adding parameters. This framework significantly reduces overfitting when there is limited paired data available, and is effective for translating between pairs of languages not seen during training.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderMachine TranslationSentenceTranslationSimilar Papers 제목 키워드 기반
A Generative Framework for Simultaneous Machine Translation
We propose a generative framework for simultaneous machine translation. Conventional approaches use a fixed number of source words to translate or learn dynamic policies for the number of source words by reinforcement le…
Machine Translationreinforcement-learningReinforcement Learning (RL)TranslationQuick Back-Translation for Unsupervised Machine Translation
The field of unsupervised machine translation has seen significant advancement from the marriage of the Transformer and the back-translation algorithm. The Transformer is a powerful generative model, and back-translation…
DecoderMachine TranslationTranslationUnsupervised Machine TranslationImprovement in Machine Translation with Generative Adversarial Networks
In this paper, we explore machine translation improvement via Generative Adversarial Network (GAN) architecture. We take inspiration from RelGAN, a model for text generation, and NMT-GAN, an adversarial machine translati…
Generative Adversarial NetworkMachine TranslationNMTSentence+2Neural Machine Translation with Gumbel-Greedy Decoding
Previous neural machine translation models used some heuristic search algorithms (e.g., beam search) in order to avoid solving the maximum a posteriori problem over translation sentences at test time. In this paper, we p…
Heuristic SearchMachine TranslationTranslationA Stochastic Decoder for Neural Machine Translation
The process of translation is ambiguous, in that there are typically many valid trans- lations for a given sentence. This gives rise to significant variation in parallel cor- pora, however, most current models of machine…
DecoderMachine TranslationSentenceTranslation+2