paper-with-me

홈 › Papers

Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies

2019-05-14 · ACL 2019 7 · Yunsu Kim, Yingbo Gao, Hermann Ney

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a pre-trained NMT model to a new, unrelated language without shared vocabularies. We relieve the vocabulary mismatch by using cross-lingual word embedding, train a more language-agnostic encoder by injecting artificial noises, and generate synthetic data easily from the pre-training data without back-translation. Our methods do not require restructuring the vocabulary or retraining the model. We improve plain NMT transfer by up to +5.1% BLEU in five low-resource translation tasks, outperforming multilingual joint training by a large margin. We also provide extensive ablation studies on pre-trained embedding, synthetic data, vocabulary size, and parameter freezing for a better understanding of NMT transfer.

📄 PDF Abstract BibTeX arXiv:1905.05475

Code (1)

yunsukim86/sockeye-transfer 공식 구현 mxnet

Tasks

Cross-Lingual TransferLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMTTransfer LearningTranslation

Similar Papers 제목 키워드 기반

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation

2019-09-01 · Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan 외

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation perf…

Cross-Lingual TransferMachine TranslationNMTTransfer Learning+1

Analyzing and Improving Cross-lingual Knowledge Transfer for Machine Translation

2026-01-07 · David Stap arxiv

Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-res…

Machine Translation

Cross-lingual Word Embeddings beyond Zero-shot Machine Translation

2020-11-03 · Shifei Chen, Ali Basirat

We explore the transferability of a multilingual neural machine translation model to unseen languages when the transfer is grounded solely on the cross-lingual word embeddings. Our experimental results show that the tran…

Cross-Lingual Word EmbeddingsMachine TranslationTranslationWord Embeddings+1

Cross-lingual Pre-training Based Transfer for Zero-shot Neural Machine Translation

2019-12-03 · Baijun Ji, Zhirui Zhang, Xiangyu Duan, Min Zhang 외

Transfer learning between different language pairs has shown its effectiveness for Neural Machine Translation (NMT) in low-resource scenario. However, existing transfer methods involving a common target language are far …

Machine TranslationNMTTransfer LearningTranslation

Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning?

2024-03-25 · Shaoxiong Ji, Timothee Mickus, Vincent Segonne, Jörg Tiedemann

Multilingual pretraining and fine-tuning have remarkably succeeded in various natural language processing tasks. Transferring representations from one language to another is especially crucial for cross-lingual learning.…

Cross-Lingual TransferMachine TranslationNatural Language UnderstandingRepresentation Learning+3