paper-with-me

Papers

Zero-Shot Dual Machine Translation

2018-05-25 · Lierni Sestorain, Massimiliano Ciaramita, Christian Buck, Thomas Hofmann

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines zero-shot and dual learning. The latter relies on reinforcement learning, to exploit the duality of the machine translation task, and requires only monolingual data for the target language pair. Experiments show that a zero-shot dual system, trained on English-French and English-Spanish, outperforms by large margins a standard NMT system in zero-shot translation performance on Spanish-French (both directions). The zero-shot dual method approaches the performance, within 2.2 BLEU points, of a comparable supervised setting. Our method can obtain improvements also on the setting where a small amount of parallel data for the zero-shot language pair is available. Adding Russian, to extend our experiments to jointly modeling 6 zero-shot translation directions, all directions improve between 4 and 15 BLEU points, again, reaching performance near that of the supervised setting.

📄 PDF Abstract BibTeX arXiv:1805.10338

Code (1)

liernisestorain/zero-shot-dual-MT tf

Tasks

Machine TranslationNMTReinforcement LearningTranslation

Similar Papers 제목 키워드 기반

Towards Boosting Many-to-Many Multilingual Machine Translation with Large Language Models

2024-01-11 · Pengzhi Gao, Zhongjun He, Hua Wu, Haifeng Wang

The training paradigm for machine translation has gradually shifted, from learning neural machine translation (NMT) models with extensive parallel corpora to instruction finetuning on multilingual large language models (…

Machine TranslationNMTTranslation

Improving Zero-Shot Translation of Low-Resource Languages

2018-11-04 · IWSLT 2017 12 · Surafel M. Lakew, Quintino F. Lotito, Matteo Negri, Marco Turchi 외

Recent work on multilingual neural machine translation reported competitive performance with respect to bilingual models and surprisingly good performance even on (zeroshot) translation directions not observed at trainin…

Machine TranslationTranslation

MALM: Mixing Augmented Language Modeling for Zero-Shot Machine Translation

2022-10-01 · Kshitij Gupta

Large pre-trained language models have brought remarkable progress in NLP. Pre-training and Fine-tuning have given state-of-art performance across tasks in text processing. Data Augmentation techniques have also helped b…

Data AugmentationLanguage ModelingLanguage ModellingMachine Translation+2

Fine-tuning Large Language Models for Adaptive Machine Translation

2023-12-20 · Yasmin Moslem, Rejwanul Haque, Andy Way

This paper presents the outcomes of fine-tuning Mistral 7B, a general-purpose large language model (LLM), for adaptive machine translation (MT). The fine-tuning process involves utilising a combination of zero-shot and o…

In-Context LearningLanguage ModellingLarge Language ModelMachine Translation+1

Language Tags Matter for Zero-Shot Neural Machine Translation

2021-06-15 · Findings (ACL) 2021 8 · Liwei Wu, Shanbo Cheng, Mingxuan Wang, Lei LI

Multilingual Neural Machine Translation (MNMT) has aroused widespread interest due to its efficiency. An exciting advantage of MNMT models is that they could also translate between unsupervised (zero-shot) language direc…

Machine TranslationTAGTranslation