paper-with-me

Papers

Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts

2024-09-17 · Teng Wang, Zhenqi He, Wing-Yin Yu, Xiaojin Fu, Xiongwei Han

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long contexts, LLMs often struggle to follow all specified rules, frequently omitting at least one. To enhance the reasoning and understanding of LLMs on long and complex contexts, we propose a novel prompting strategy Multi-Lingual Prompt, namely MLPrompt, which automatically translates the error-prone rule that an LLM struggles to follow into another language, thus drawing greater attention to it. Experimental results on public datasets across various tasks have shown MLPrompt can outperform state-of-the-art prompting methods such as Chain of Thought, Tree of Thought, and Self-Consistency. Additionally, we introduce a framework integrating MLPrompt with an auto-checking mechanism for structured data generation, with a specific case study in text-to-MIP instances. Further, we extend the proposed framework for text-to-SQL to demonstrate its generation ability towards structured data synthesis.

📄 PDF Abstract BibTeX arXiv:2409.11056

Code (1)

tengwang0318/MLPrompt 공식 구현

Tasks

Text to SQLText-To-SQL

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners

2024-05-22 · Shimao Zhang, Changjiang Gao, Wenhao Zhu, Jiajun Chen 외

Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation…

Translation

Implementing a Multi-lingual Chatbot for Positive Reinforcement in Young Learners

2019-08-01 · WS 2019 8 · Francisca Oladipo, Abdulmalik Rufai

This is a humanitarian work {--}a counter-terrorism effort. The presentation describes the experiences of developing a multi-lingua, interactive chatbot trained on the corpus of two Nigerian Languages (Hausa and Fulfude)…

ChatbotHumanitarianTranslation

JSI at SemEval-2022 Task 1: CODWOE - Reverse Dictionary: Monolingual and cross-lingual approaches

2022-07-01 · SemEval (NAACL) 2022 7 · Thi Hong Hanh Tran, Matej Martinc, Matthew Purver, Senja Pollak

The reverse dictionary task is a sequence-to-vector task in which a gloss is provided as input, and the output must be a semantically matching word vector. The reverse dictionary is useful in practical applications such …

Reverse DictionaryZero-Shot Learning

LeSpell - A Multi-Lingual Benchmark Corpus of Spelling Errors to Develop Spellchecking Methods for Learner Language

2022-06-01 · LREC 2022 6 · Marie Bexte, Ronja Laarmann-Quante, Andrea Horbach, Torsten Zesch

Spellchecking text written by language learners is especially challenging because errors made by learners differ both quantitatively and qualitatively from errors made by already proficient learners. We introduce LeSpell…

Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learning

2023-06-09 · Hengyuan Zhang, Dawei Li, Yanran Li, Chenming Shang 외

The standard definition generation task requires to automatically produce mono-lingual definitions (e.g., English definitions for English words), but ignores that the generated definitions may also consist of unfamiliar …

Machine TranslationPrompt Learning