paper-with-me

홈 › Papers

BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation

2021-11-12 · Findings (NAACL) 2022 7 · Eleftheria Briakou, Sida I. Wang, Luke Zettlemoyer, Marjan Ghazvininejad

Mined bitexts can contain imperfect translations that yield unreliable training signals for Neural Machine Translation (NMT). While filtering such pairs out is known to improve final model quality, we argue that it is suboptimal in low-resource conditions where even mined data can be limited. In our work, we propose instead, to refine the mined bitexts via automatic editing: given a sentence in a language xf, and a possibly imperfect translation of it xe, our model generates a revised version xf' or xe' that yields a more equivalent translation pair (i.e., <xf, xe'> or <xf', xe>). We use a simple editing strategy by (1) mining potentially imperfect translations for each sentence in a given bitext, (2) learning a model to reconstruct the original translations and translate, in a multi-task fashion. Experiments demonstrate that our approach successfully improves the quality of CCMatrix mined bitext for 5 low-resource language-pairs and 10 translation directions by up to ~ 8 BLEU points, in most cases improving upon a competitive back-translation baseline.

📄 PDF Abstract BibTeX arXiv:2111.06787

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTSentenceTranslation

Similar Papers 제목 키워드 기반

xSIM++: An Improved Proxy to Bitext Mining Performance for Low-Resource Languages

2023-06-22 · Mingda Chen, Kevin Heffernan, Onur Çelebi, Alex Mourachko 외

We introduce a new proxy score for evaluating bitext mining based on similarity in a multilingual embedding space: xSIM++. In comparison to xSIM, this improved proxy leverages rule-based approaches to extend English sent…

NMT

Bitext Mining for Low-Resource Languages via Contrastive Learning

2022-08-23 · Weiting Tan, Philipp Koehn

Mining high-quality bitexts for low-resource languages is challenging. This paper shows that sentence representation of language models fine-tuned with multiple negatives ranking loss, a contrastive objective, helps retr…

Contrastive LearningSentence

Comparing two acquisition systems for automatically building an English---Croatian parallel corpus from multilingual websites

2014-05-01 · LREC 2014 5 · Miquel Espl{\`a}-Gomis, Filip Klubi{\v{c}}ka, Nikola Ljube{\v{s}}i{\'c}, Sergio Ortiz-Rojas 외

In this paper we compare two tools for automatically harvesting bitexts from multilingual websites: bitextor and ILSP-FC. We used both tools for crawling 21 multilingual websites from the tourism domain to build a domain…

Information RetrievalMachine TranslationNatural Language Inference

AUGVIC: Exploiting BiText Vicinity for Low-Resource NMT

2021-06-09 · Findings (ACL) 2021 8 · Tasnim Mohiuddin, M Saiful Bari, Shafiq Joty

The success of Neural Machine Translation (NMT) largely depends on the availability of large bitext training corpora. Due to the lack of such large corpora in low-resource language pairs, NMT systems often exhibit poor p…

Data AugmentationLow Resource NMTMachine TranslationNMT+1

Can Synthetic Translations Improve Bitext Quality?

2022-03-15 · ACL 2022 5 · Eleftheria Briakou, Marine Carpuat

Synthetic translations have been used for a wide range of NLP tasks primarily as a means of data augmentation. This work explores, instead, how synthetic translations can be used to revise potentially imperfect reference…

Data AugmentationNMT