paper-with-me

홈 › Papers

AUGVIC: Exploiting BiText Vicinity for Low-Resource NMT

2021-06-09 · Findings (ACL) 2021 8 · Tasnim Mohiuddin, M Saiful Bari, Shafiq Joty

The success of Neural Machine Translation (NMT) largely depends on the availability of large bitext training corpora. Due to the lack of such large corpora in low-resource language pairs, NMT systems often exhibit poor performance. Extra relevant monolingual data often helps, but acquiring it could be quite expensive, especially for low-resource languages. Moreover, domain mismatch between bitext (train/test) and monolingual data might degrade the performance. To alleviate such issues, we propose AUGVIC, a novel data augmentation framework for low-resource NMT which exploits the vicinal samples of the given bitext without using any extra monolingual data explicitly. It can diversify the in-domain bitext data with finer level control. Through extensive experiments on four low-resource language pairs comprising data from different domains, we have shown that our method is comparable to the traditional back-translation that uses extra in-domain monolingual data. When we combine the synthetic parallel data generated from AUGVIC with the ones from the extra monolingual data, we achieve further improvements. We show that AUGVIC helps to attenuate the discrepancies between relevant and distant-domain monolingual data in traditional back-translation. To understand the contributions of different components of AUGVIC, we perform an in-depth framework analysis.

📄 PDF Abstract BibTeX arXiv:2106.05141

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationLow Resource NMTMachine TranslationNMTTranslation

Similar Papers 제목 키워드 기반

Bitext Mining for Low-Resource Languages via Contrastive Learning

2022-08-23 · Weiting Tan, Philipp Koehn

Mining high-quality bitexts for low-resource languages is challenging. This paper shows that sentence representation of language models fine-tuned with multiple negatives ranking loss, a contrastive objective, helps retr…

Contrastive LearningSentence

BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation

2021-11-12 · Findings (NAACL) 2022 7 · Eleftheria Briakou, Sida I. Wang, Luke Zettlemoyer, Marjan Ghazvininejad

Mined bitexts can contain imperfect translations that yield unreliable training signals for Neural Machine Translation (NMT). While filtering such pairs out is known to improve final model quality, we argue that it is su…

Machine TranslationNMTSentenceTranslation

xSIM++: An Improved Proxy to Bitext Mining Performance for Low-Resource Languages

2023-06-22 · Mingda Chen, Kevin Heffernan, Onur Çelebi, Alex Mourachko 외

We introduce a new proxy score for evaluating bitext mining based on similarity in a multilingual embedding space: xSIM++. In comparison to xSIM, this improved proxy leverages rule-based approaches to extend English sent…

NMT

Exploiting Monolingual Data at Scale for Neural Machine Translation

2019-11-01 · IJCNLP 2019 11 · Lijun Wu, Yiren Wang, Yingce Xia, Tao Qin 외

While target-side monolingual data has been proven to be very useful to improve neural machine translation (briefly, NMT) through back translation, source-side monolingual data is not well investigated. In this work, we …

Machine TranslationNMTTranslation

Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages

2022-05-25 · Kevin Heffernan, Onur Çelebi, Holger Schwenk

Scaling multilingual representation learning beyond the hundred most frequent languages is challenging, in particular to cover the long tail of low-resource languages. A promising approach has been to train one-for-all m…

Cross-Lingual TransferNMTRepresentation LearningSentence