Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer
Pivot-based neural machine translation (NMT) is commonly used in low-resource setups, especially for translation between non-English language pairs. It benefits from using high resource source-pivot and pivot-target language pairs and an individual system is trained for both sub-tasks. However, these models have no connection during training, and the source-pivot model is not optimized to produce the best translation for the source-target task. In this work, we propose to train a pivot-based NMT system with the reinforcement learning (RL) approach, which has been investigated for various text generation tasks, including machine translation (MT). We utilize a non-autoregressive transformer and present an end-to-end pivot-based integrated model, enabling training on source-target data.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTreinforcement-learningReinforcement Learning (RL)Text GenerationTranslationSimilar Papers 제목 키워드 기반
Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation
Multilingual neural machine translation (MNMT) aims at using one single model for multiple translation directions. Recent work applies non-autoregressive Transformers to improve the efficiency of MNMT, but requires expen…
Knowledge DistillationMachine TranslationTranslationIntegrated Training for Sequence-to-Sequence Models Using Non-Autoregressive Transformer
Complex natural language applications such as speech translation or pivot translation traditionally rely on cascaded models. However, cascaded models are known to be prone to error propagation and model discrepancy probl…
Machine TranslationTranslationRetrieving Sequential Information for Non-Autoregressive Neural Machine Translation
Non-Autoregressive Transformer (NAT) aims to accelerate the Transformer model through discarding the autoregressive mechanism and generating target words independently, which fails to exploit the target sequential inform…
DecoderMachine TranslationSentenceTranslationNon-Autoregressive Machine Translation with Latent Alignments
This paper presents two strong methods, CTC and Imputer, for non-autoregressive machine translation that model latent alignments with dynamic programming. We revisit CTC for machine translation and demonstrate that a sim…
Machine TranslationTranslationRephrasing the Reference for Non-Autoregressive Machine Translation
Non-autoregressive neural machine translation (NAT) models suffer from the multi-modality problem that there may exist multiple possible translations of a source sentence, so the reference sentence may be inappropriate f…
Machine TranslationSentenceTranslation