paper-with-me

홈 › Papers

Enhanced back-translation for low resource neural machine translation using self-training

2020-06-04 · Idris Abdulmumin, Bashir Shehu Galadanci, Abubakar Isa

Improving neural machine translation (NMT) models using the back-translations of the monolingual target data (synthetic parallel data) is currently the state-of-the-art approach for training improved translation systems. The quality of the backward system - which is trained on the available parallel data and used for the back-translation - has been shown in many studies to affect the performance of the final NMT model. In low resource conditions, the available parallel data is usually not enough to train a backward model that can produce the qualitative synthetic data needed to train a standard translation model. This work proposes a self-training strategy where the output of the backward model is used to improve the model itself through the forward translation technique. The technique was shown to improve baseline low resource IWSLT'14 English-German and IWSLT'15 English-Vietnamese backward translation models by 11.06 and 1.5 BLEUs respectively. The synthetic data generated by the improved English-German backward model was used to train a forward model which out-performed another forward model trained using standard back-translation by 2.7 BLEU.

📄 PDF Abstract BibTeX arXiv:2006.02876

Code (0)

등록된 구현이 없습니다.

Tasks

Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMTTranslation

Similar Papers 제목 키워드 기반

DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms

2024-06-11 · Andong Chen, Lianzhang Lou, Kehai Chen, Xuefeng Bai 외

Recently, large language models (LLMs) enhanced by self-reflection have achieved promising performance on machine translation. The key idea is guiding LLMs to generate translation with human-like feedback. However, exist…

Machine TranslationTranslation

A Hybrid Approach for Improved Low Resource Neural Machine Translation using Monolingual Data

2020-11-14 · Idris Abdulmumin, Bashir Shehu Galadanci, Abubakar Isa, Habeebah Adamu Kakudi 외

Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. M…

Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMT+2

SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

2020-10-11 · Zuchao Li, Hai Zhao, Rui Wang, Kehai Chen 외

In this paper, we introduced our joint team SJTU-NICT 's participation in the WMT 2020 machine translation shared task. In this shared task, we participated in four translation directions of three language pairs: English…

Collaborative FilteringLanguage ModelingLanguage ModellingMachine Translation+3

SJTU-NICT’s Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

2020-11-01 · WMT (EMNLP) 2020 11 · Zuchao Li, Hai Zhao, Rui Wang, Kehai Chen 외

In this paper, we introduced our joint team SJTU-NICT ‘s participation in the WMT 2020 machine translation shared task. In this shared task, we participated in four translation directions of three language pairs: English…

Collaborative FilteringLanguage ModelingLanguage ModellingMachine Translation+3

Tagged Back-translation Revisited: Why Does It Really Work?

2020-07-01 · ACL 2020 6 · Benjamin Marie, Raphael Rubino, Atsushi Fujita

In this paper, we show that neural machine translation (NMT) systems trained on large back-translated data overfit some of the characteristics of machine-translated texts. Such NMT systems better translate human-produced…

Machine TranslationNMTTAGTranslation