From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text
Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine translation model to generate Hindi-English code-switched sentences starting from monolingual Hindi sentences. We outline a carefully designed curriculum of pretraining steps, including the use of synthetic code-switched text, that enable the model to generate high-quality code-switched text. Using text generated from our model as data augmentation, we show significant reductions in perplexity on a language modeling task, compared to using text from other generative models of CS text. We also show improvements using our text for a downstream code-switched natural language inference task. Our generated text is further subjected to a rigorous evaluation using a human evaluation study and a range of objective metrics, where we show performance comparable (and sometimes even superior) to code-switched text obtained via crowd workers who are native Hindi speakers.
Code (1)
Tasks
Data AugmentationLanguage ModelingLanguage ModellingMachine TranslationNatural Language InferenceTranslationSimilar Papers 제목 키워드 기반
CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units
Multilingual code-switching research is often hindered by the lack and linguistically biased status of available datasets. To expand language representation, we synthesize code-switching data by replacing intonation unit…
Machine TranslationSpeech-to-TextSpeech-to-Text TranslationTranslationLow-resource Machine Translation for Code-switched Kazakh-Russian Language Pair
Machine translation for low resource language pairs is a challenging task. This task could become extremely difficult once a speaker uses code switching. We propose a method to build a machine translation model for code-…
Machine TranslationTranslationContextual Code Switching for Machine Translation using Language Models
Large language models (LLMs) have exerted a considerable impact on diverse language-related tasks in recent years. Their demonstrated state-of-the-art performance is achieved through methodologies such as zero-shot or fe…
Machine TranslationQuestion AnsweringTranslationUniCoM: A Universal Code-Switching Speech Generator
Code-switching (CS), the alternation between two or more languages within a single speaker's utterances, is common in real-world conversations and poses significant challenges for multilingual speech technology. However,…
Speech-to-Text TranslationSpeech RecognitionChecks and Strategies for Enabling Code-Switched Machine Translation
Code-switching is a common phenomenon among multilingual speakers, where alternation between two or more languages occurs within the context of a single conversation. While multilingual humans can seamlessly switch back …
Data AugmentationMachine TranslationNMTTranslation