paper-with-me

Papers

Iterative Constrained Back-Translation for Unsupervised Domain Adaptation of Machine Translation

2022-10-01 · COLING 2022 10 · Hongxiao Zhang, Hui Huang, Jiale Gao, Yufeng Chen, Jinan Xu, Jian Liu

Back-translation has been proven to be effective in unsupervised domain adaptation of neural machine translation (NMT). However, the existing back-translation methods mainly improve domain adaptability by generating in-domain pseudo-parallel data that contains sentence-structural knowledge, paying less attention to the in-domain lexical knowledge, which may lead to poor translation of unseen in-domain words. In this paper, we propose an Iterative Constrained Back-Translation (ICBT) method to incorporate in-domain lexical knowledge on the basis of BT for unsupervised domain adaptation of NMT. Specifically, we apply lexical constraints into back-translation to generate pseudo-parallel data with in-domain lexical knowledge, and then perform round-trip iterations to incorporate more lexical knowledge. Based on this, we further explore sampling strategies of constrained words in ICBT to introduce more targeted lexical knowledge, via domain specificity and confidence estimation. Experimental results on four domains show that our approach achieves state-of-the-art results, improving the BLEU score by up to 3.08 compared to the strongest baseline, which demonstrates the effectiveness of our approach.

📄 PDF Abstract BibTeX

Code (1)

zzzxiaohong/icbt 공식 구현 pytorch

Tasks

Domain AdaptationMachine TranslationNMTSentenceSpecificityTranslationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Zero-Shot Language Transfer vs Iterative Back Translation for Unsupervised Machine Translation

2021-03-31 · Aviral Joshi, Chengzhi Huang, Har Simrat Singh

This work focuses on comparing different solutions for machine translation on low resource language pairs, namely, with zero-shot transfer learning and unsupervised machine translation. We discuss how the data size affec…

Machine TranslationTransfer LearningTranslationUnsupervised Machine Translation

The NiuTrans Machine Translation Systems for WMT19

2019-08-01 · WS 2019 8 · Bei Li, Yinqiao Li, Chen Xu, Ye Lin 외

This paper described NiuTrans neural machine translation systems for the WMT 2019 news translation tasks. We participated in 13 translation directions, including 11 supervised tasks, namely EN↔{ZH, DE, RU, KK, LT}, GU→EN…

Knowledge DistillationMachine TranslationNMTReranking+1

An Iterative Knowledge Transfer NMT System for WMT20 News Translation Task

2020-11-01 · WMT (EMNLP) 2020 11 · Jiwan Kim, Soyoon Park, Sangha Kim, Yoonjung Choi

This paper describes our submission to the WMT20 news translation shared task in English to Japanese direction. Our main approach is based on transferring knowledge of domain and linguistic characteristics by pre-trainin…

DecoderNMTTransfer LearningTranslation

Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Lexically constrained neural machine translation (NMT) draws much industrial attention for its practical usage in specific domains. However, current autoregressive approaches suffer from high latency. In this paper, we f…

Machine TranslationNMTTranslation

A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation

2020-07-01 · ACL 2020 6 · Shuo Ren, Yu Wu, Shujie Liu, Ming Zhou 외

The commonly used framework for unsupervised machine translation builds initial translation models of both translation directions, and then performs iterative back-translation to jointly boost their translation performan…

Machine TranslationNMTRetrievalSentence+2