Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages
This paper introduces Chain of Translation Prompting (CoTR), a novel strategy designed to enhance the performance of language models in low-resource languages. CoTR restructures prompts to first translate the input context from a low-resource language into a higher-resource language, such as English. The specified task like generation, classification, or any other NLP function is then performed on the translated text, with the option to translate the output back to the original language if needed. All these steps are specified in a single prompt. We demonstrate the effectiveness of this method through a case study on the low-resource Indic language Marathi. The CoTR strategy is applied to various tasks, including sentiment analysis, hate speech classification, subject classification and text generation, and its efficacy is showcased by comparing it with regular prompting methods. Our results underscore the potential of translation-based prompting strategies to significantly improve multilingual LLM performance in low-resource languages, offering valuable insights for future research and applications. We specifically see the highest accuracy improvements with the hate speech detection task. The technique also has the potential to enhance the quality of synthetic data generation for underrepresented languages using LLMs.
Code (0)
등록된 구현이 없습니다.
Tasks
Hate Speech DetectionSentiment AnalysisSynthetic Data GenerationText GenerationTranslationSimilar Papers 제목 키워드 기반
HiCoTraj:Zero-Shot Demographic Reasoning via Hierarchical Chain-of-Thought Prompting from Trajectory
Inferring demographic attributes such as age, sex, or income level from human mobility patterns enables critical applications such as targeted public health interventions, equitable urban planning, and personalized trans…
Zero-Shot LearningLearning-From-Mistakes Prompting for Indigenous Language Translation
Using large language models, this paper presents techniques to improve extremely low-resourced indigenous language translations. Our approaches are grounded in the use of (1) the presence of a datastore consisting of a l…
In-Context LearningTranslationKnowledge-Prompted Estimator: A Novel Approach to Explainable Machine Translation Assessment
Cross-lingual Machine Translation (MT) quality estimation plays a crucial role in evaluating translation performance. GEMBA, the first MT quality assessment metric based on Large Language Models (LLMs), employs one-step …
Machine TranslationSentenceTranslationError Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models
Generative large language models (LLMs), e.g., ChatGPT, have demonstrated remarkable proficiency across several NLP tasks, such as machine translation, text summarization. Recent research (Kocmi and Federmann, 2023) has …
Machine TranslationNatural Language UnderstandingQuestion AnsweringText Summarization+1Chain-of-Thought Prompting for Speech Translation
Large language models (LLMs) have demonstrated remarkable advancements in language understanding and generation. Building on the success of text-based LLMs, recent research has adapted these models to use speech embeddin…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)automatic-speech-translationDecoder+3