CoMeT: Towards Code-Mixed Translation Using Parallel Monolingual Sentences
Code-mixed languages are very popular in multilingual societies around the world, yet the resources lag behind to enable robust systems on such languages. A major contributing factor is the informal nature of these languages which makes it difficult to collect code-mixed data. In this paper, we propose our system for Task 1 of CACLS 2021 to generate a machine translation system for English to Hinglish in a supervised setting. Translating in the given direction can help expand the set of resources for several tasks by translating valuable datasets from high resource languages. We propose to use mBART, a pre-trained multilingual sequence-to-sequence model, and fully utilize the pre-training of the model by transliterating the roman Hindi words in the code-mixed sentences to Devanagri script. We evaluate how expanding the input by concatenating Hindi translations of the English sentences improves mBART’s performance. Our system gives a BLEU score of 12.22 on test set. Further, we perform a detailed error analysis of our proposed systems and explore the limitations of the provided dataset and metrics.
Code (1)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
VietMix: A Naturally Occurring Vietnamese-English Code-Mixed Corpus with Iterative Augmentation for Machine Translation
Machine translation systems fail when processing code-mixed inputs for low-resource languages. We address this challenge by curating VietMix, a parallel corpus of naturally occurring code-mixed Vietnamese text paired wit…
Machine TranslationSynthetic Data GenerationTranslationCode-Mixed to Monolingual Translation Framework
The use of multilingualism in the new generation is widespread in the form of code-mixed data on social media, and therefore a robust translation system is required for catering to the monolingual users, as well as for e…
Language ModelingLanguage ModellingTranslationTransliterationExploring Parameter-Efficient Fine-Tuning and Backtranslation for the WMT 25 General Translation Task
In this paper, we explore the effectiveness of combining fine-tuning and backtranslation on a small Japanese corpus for neural machine translation. Starting from a baseline English{\textrightarrow}Japanese model (COMET =…
parameter-efficient fine-tuningMachine TranslationAdapting Multilingual Models for Code-Mixed Translation using Back-to-Back Translation
In this paper, we explore the problem of translating code-mixed sentences to an equivalent monolingual form. The scarcity of gold standard code-mixed to pure language parallel data makes it difficult to train a translati…
Data AugmentationMachine TranslationTranslationPhraseOut: A Code Mixed Data Augmentation Method for MultilingualNeural Machine Tranlsation
Data Augmentation methods for Neural Machine Translation (NMT) such as back- translation (BT) and self-training (ST) are quite popular. In a multilingual NMT system, simply copying monolingual source sentences to the tar…
Data AugmentationMachine TranslationNMTSentence+1