Improving Low-Resource Machine Translation via Round-Trip Reinforcement Learning
Low-resource machine translation (MT) has gained increasing attention as parallel data from low-resource language communities is collected, but many approaches for improving low-resource MT remain underexplored. We investigate a self-supervised reinforcement learning fine-tuning for translation in low-resource settings using round-trip bootstrapping with the No Language Left Behind (NLLB) family of models. Our approach translates English into a target low-resource language and then back into English, using a combination of chrF++ and BLEU as the reward function on the reconstructed English sentences. Using the NLLB-MD dataset, we evaluate both the 600M and 1.3B parameter NLLB models and observe consistent improvements for the following languages: Central Aymara, Friulian, Wolof, Dyula, Bhojpuri and Russian. Qualitative inspection of translation outputs indicates increased fluency and semantic fidelity. We argue that our method can further benefit from scale, enabling models to increasingly leverage their pretrained knowledge and continue self-improving. Code available at: https://github.com/Copticoder/MT-via-Round-Trip-RL
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningMachine TranslationSimilar Papers 제목 키워드 기반
Rethinking Round-Trip Translation for Machine Translation Evaluation
Automatic evaluation on low-resource language translation suffers from a deficiency of parallel corpora. Round-trip translation could be served as a clever and straightforward technique to alleviate the requirement of th…
Machine TranslationTranslationBilingual Low-Resource Neural Machine Translation with Round-Tripping: The Case of Persian-Spanish
The quality of Neural Machine Translation (NMT), as a data-driven approach, massively depends on quantity, quality, and relevance of the training dataset. Such approaches have achieved promising results for bilingually h…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationLow Resource NMTMachine Translation+2COMET-QE and Active Learning for Low-Resource Machine Translation
Active learning aims to deliver maximum benefit when resources are scarce. We use COMET-QE, a reference-free evaluation metric, to select sentences for low-resource neural machine translation. Using Swahili, Kinyarwanda …
Active LearningLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translation+2RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languages
Optical Character Recognition (OCR) technology has revolutionized the digitization of printed text, enabling efficient data extraction and analysis across various domains. Just like Machine Translation systems, OCR syste…
Machine TranslationOptical Character RecognitionOptical Character Recognition (OCR)Synthetic Data Generation+1Lost In Translation: Generating Adversarial Examples Robust to Round-Trip Translation
Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain conside…
Machine TranslationTranslation