paper-with-me

Papers

Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages

2023-03-23 · Zheng-Xin Yong, Ruochen Zhang, Jessica Zosa Forde, Skyler Wang, Arjun Subramonian, Holy Lovenia, Samuel Cahyawijaya, Genta Indra Winata, Lintang Sutawika, Jan Christian Blaise Cruz, Yin Lin Tan, Long Phan, Rowena Garcia, Thamar Solorio, Alham Fikri Aji

While code-mixing is a common linguistic practice in many parts of the world, collecting high-quality and low-cost code-mixed data remains a challenge for natural language processing (NLP) research. The recent proliferation of Large Language Models (LLMs) compels one to ask: how capable are these systems in generating code-mixed data? In this paper, we explore prompting multilingual LLMs in a zero-shot manner to generate code-mixed data for seven languages in South East Asia (SEA), namely Indonesian, Malay, Chinese, Tagalog, Vietnamese, Tamil, and Singlish. We find that publicly available multilingual instruction-tuned models such as BLOOMZ and Flan-T5-XXL are incapable of producing texts with phrases or clauses from different languages. ChatGPT exhibits inconsistent capabilities in generating code-mixed texts, wherein its performance varies depending on the prompt template and language pairing. For instance, ChatGPT generates fluent and natural Singlish texts (an English-based creole spoken in Singapore), but for English-Tamil language pair, the system mostly produces grammatically incorrect or semantically meaningless utterances. Furthermore, it may erroneously introduce languages not specified in the prompt. Based on our investigation, existing multilingual LLMs exhibit a wide range of proficiency in code-mixed data generation for SEA languages. As such, we advise against using LLMs in this context without extensive human checks.

📄 PDF Abstract BibTeX arXiv:2303.13592

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

BLOOMZ BLOOMZ is a Multitask prompted finetuning (MTF) variant of BLOOM.

Similar Papers 제목 키워드 기반

Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs' Code-Mixing Capabilities

2024-10-14 · Ayushman Gupta, Akhil Bhogal, Kripabandhu Ghosh

Multilingual Large Language Models (LLMs) have demonstrated exceptional performance in Machine Translation (MT) tasks. However, their MT abilities in the context of code-switching (the practice of mixing two or more lang…

ChatbotMachine TranslationTranslation

Multilingual Prompting for Improving LLM Generation Diversity

2025-05-21 · Qihan Wang, Shidong Pan, Tal Linzen, Emily Black

Large Language Models (LLMs) are known to lack cultural representation and overall diversity in their generations, from expressing opinions to answering factual questions. To mitigate this problem, we propose multilingua…

DiversityHallucination

LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting

2023-05-31 · Rita Ramos, Bruno Martins, Desmond Elliott

Multilingual image captioning has recently been tackled by training with large-scale machine translated data, which is an expensive, noisy, and time-consuming process. Without requiring any multilingual caption data, we …

DecoderImage CaptioningLanguage ModelingLanguage Modelling+1

Decomposed Prompting: Unveiling Multilingual Linguistic Structure Knowledge in English-Centric Large Language Models

2024-02-28 · Ercong Nie, Shuzhou Yuan, Bolei Ma, Helmut Schmid 외

Despite the predominance of English in their training data, English-centric Large Language Models (LLMs) like GPT-3 and LLaMA display a remarkable ability to perform multilingual tasks, raising questions about the depth …

Part-Of-Speech TaggingSentence

Multilingual Large Language Models Are Not (Yet) Code-Switchers

2023-05-23 · Ruochen Zhang, Samuel Cahyawijaya, Jan Christian Blaise Cruz, Genta Indra Winata 외

Multilingual Large Language Models (LLMs) have recently shown great capabilities in a wide range of tasks, exhibiting state-of-the-art performance through zero-shot or few-shot prompting methods. While there have been ex…

BenchmarkingLanguage IdentificationMachine TranslationSentiment Analysis