Prior Knowledge Integration for Neural Machine Translation using Posterior Regularization
Although neural machine translation has made significant progress recently, how to integrate multiple overlapping, arbitrary prior knowledge sources remains a challenge. In this work, we propose to use posterior regularization to provide a general framework for integrating prior knowledge into neural machine translation. We represent prior knowledge sources as features in a log-linear model, which guides the learning process of the neural translation model. Experiments on Chinese-English translation show that our approach leads to significant improvements.
Code (1)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment
Sign language translation (SLT) aims to convert continuous sign language videos into textual sentences. As a typical multi-modal task, there exists an inherent modality gap between sign language videos and spoken languag…
cross-modal alignmentDecoderSign Language TranslationTranslationBetter Document-Level Machine Translation with Bayes' Rule
We show that Bayes' rule provides an effective mechanism for creating document translation models that can be learned from only parallel sentences and monolingual documents---a compelling benefit as parallel documents ar…
Document Level Machine TranslationDocument TranslationLanguage ModelingLanguage Modelling+3Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting
Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT model…
DecoderMachine TranslationNMTTranslationIntegration of Dubbing Constraints into Machine Translation
Translation systems aim to perform a meaning-preserving conversion of linguistic material (typically text but also speech) from a source to a target language (and, to a lesser degree, the corresponding socio-cultural con…
DecoderMachine TranslationTranslationSelf-explaining variational posterior distributions for Gaussian Process models
Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comp…
BIG-bench Machine Learning