Training Data Augmentation for Code-Mixed Translation
Machine translation of user-generated code-mixed inputs to English is of crucial importance in applications like web search and targeted advertising. We address the scarcity of parallel training data for training such models by designing a strategy of converting existing non-code-mixed parallel data sources to code-mixed parallel data. We present an m-BERT based procedure whose core learnable component is a ternary sequence labeling model, that can be trained with a limited code-mixed corpus alone. We show a 5.8 point increase in BLEU on heavily code-mixed sentences by training a translation model using our data augmentation strategy on an Hindi-English code-mixed translation task.
Code (1)
Tasks
Data AugmentationMachine TranslationTranslationSimilar Papers 제목 키워드 기반
Enabling Code-Mixed Translation: Parallel Corpus Creation and MT Augmentation Approach
Code-mixing, use of two or more languages in a single sentence, is ubiquitous; generated by multi-lingual speakers across the world. The phenomenon presents itself prominently in social media discourse. Consequently, the…
Machine TranslationSentenceTranslationAdapting Multilingual Models for Code-Mixed Translation using Back-to-Back Translation
In this paper, we explore the problem of translating code-mixed sentences to an equivalent monolingual form. The scarcity of gold standard code-mixed to pure language parallel data makes it difficult to train a translati…
Data AugmentationMachine TranslationTranslationVietMix: A Naturally Occurring Vietnamese-English Code-Mixed Corpus with Iterative Augmentation for Machine Translation
Machine translation systems fail when processing code-mixed inputs for low-resource languages. We address this challenge by curating VietMix, a parallel corpus of naturally occurring code-mixed Vietnamese text paired wit…
Machine TranslationSynthetic Data GenerationTranslationPhraseOut: A Code Mixed Data Augmentation Method for MultilingualNeural Machine Tranlsation
Data Augmentation methods for Neural Machine Translation (NMT) such as back- translation (BT) and self-training (ST) are quite popular. In a multilingual NMT system, simply copying monolingual source sentences to the tar…
Data AugmentationMachine TranslationNMTSentence+1The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)
The University of Edinburgh participated in the WMT22 shared task on code-mixed translation. This consists of two subtasks: i) generating code-mixed Hindi/English (Hinglish) text generation from parallel Hindi and Englis…
Machine TranslationText GenerationTranslation