paper-with-me

Papers

Adaptation of Machine Translation Models with Back-translated Data using Transductive Data Selection Methods

2019-06-18 · Alberto Poncelas, Gideon Maillette de Buy Wenniger, Andy Way

Data selection has proven its merit for improving Neural Machine Translation (NMT), when applied to authentic data. But the benefit of using synthetic data in NMT training, produced by the popular back-translation technique, raises the question if data selection could also be useful for synthetic data? In this work we use Infrequent N-gram Recovery (INR) and Feature Decay Algorithms (FDA), two transductive data selection methods to obtain subsets of sentences from synthetic data. These methods ensure that selected sentences share n-grams with the test set so the NMT model can be adapted to translate it. Performing data selection on back-translated data creates new challenges as the source-side may contain noise originated by the model used in the back-translation. Hence, finding n-grams present in the test set become more difficult. Despite that, in our work we show that adapting a model with a selection of synthetic data is an useful approach.

📄 PDF Abstract BibTeX arXiv:1906.07808

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTTranslation

Similar Papers 제목 키워드 기반

Filtering Back-Translated Data in Unsupervised Neural Machine Translation

2020-12-01 · COLING 2020 8 · Jyotsana Khatri, Pushpak Bhattacharyya

Unsupervised neural machine translation (NMT) utilizes only monolingual data for training. The quality of back-translated data plays an important role in the performance of NMT systems. In back-translation, all generated…

Domain AdaptationMachine TranslationNMTSentence+1

Tagged Back-translation Revisited: Why Does It Really Work?

2020-07-01 · ACL 2020 6 · Benjamin Marie, Raphael Rubino, Atsushi Fujita

In this paper, we show that neural machine translation (NMT) systems trained on large back-translated data overfit some of the characteristics of machine-translated texts. Such NMT systems better translate human-produced…

Machine TranslationNMTTAGTranslation

Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond

2020-10-23 · Xin Li, Lidong Bing, Wenxuan Zhang, Zheng Li 외

Cross-lingual adaptation with multilingual pre-trained language models (mPTLMs) mainly consists of two lines of works: zero-shot approach and translation-based approach, which have been studied extensively on the sequenc…

Cross-Lingual TransferTranslation

SYSTRAN Purely Neural MT Engines for WMT2017

2017-09-12 · WS 2017 9 · Yongchao Deng, Jungi Kim, Guillaume Klein, Catherine Kobus 외

This paper describes SYSTRAN's systems submitted to the WMT 2017 shared news translation task for English-German, in both translation directions. Our systems are built using OpenNMT, an open-source neural machine transla…

Machine TranslationTranslation

Unsupervised Domain Adaptation for Neural Machine Translation with Domain-Aware Feature Embeddings

2019-08-27 · IJCNLP 2019 11 · Zi-Yi Dou, Junjie Hu, Antonios Anastasopoulos, Graham Neubig

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised …

Domain AdaptationLanguage ModelingLanguage ModellingMachine Translation+2