LangBridge: Multilingual Reasoning Without Multilingual Supervision

2024-01-19 · Dongkeun Yoon, Joel Jang, Sungdong Kim, Seungone Kim, Sheikh Shafayat, Minjoon Seo

We introduce LangBridge, a zero-shot approach to adapt language models for multilingual reasoning tasks without multilingual supervision. LangBridge operates by bridging two models, each specialized in different aspects: (1) one specialized in understanding multiple languages (e.g., mT5 encoder) and (2) one specialized in reasoning (e.g., MetaMath). LangBridge connects the two models by introducing minimal trainable parameters between them. Despite utilizing only English data for training, LangBridge considerably enhances the performance of language models on low-resource languages across mathematical reasoning, code completion, logical reasoning, and commonsense reasoning. Our analysis suggests that the efficacy of LangBridge stems from the language-agnostic characteristics of multilingual representations. We publicly release our code and models.

📄 PDF Abstract BibTeX arXiv:2401.10695

Code (1)

kaistAI/LangBridge 공식 구현

Tasks

Code Completion Logical Reasoning Mathematical Reasoning

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Multi-Head Attention 설명 없음

Attention 설명 없음

Residual Connection 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languages

2025-08-12 · Imalsha Puranegedara, Themira Chathumina, Nisal Ranathunga, Nisansa de Silva 외 arxiv

Large Language Models (LLMs) excel in English, but their performance degrades significantly on low-resource languages (LRLs) due to English-centric training. While methods like LangBridge align LLMs with multilingual enc…

News Classification

MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning

2025-09-09 · Kosei Uemura, David Guzmán, Quang Phuoc Nguyen, Jesujoba Oluwadara Alabi 외 arxiv

Large language models excel in English but still struggle with complex reasoning in many low-resource languages (LRLs). Existing encoder-plus-decoder methods such as LangBridge and MindMerger raise accuracy on mid and hi…

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation

2020-05-11 · ACL 2020 6 · Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat 외

Over the last few years two promising research directions in low-resource neural machine translation (NMT) have emerged. The first focuses on utilizing high-resource languages to improve the quality of low-resource langu…

Low Resource Neural Machine Translation Low-Resource Neural Machine Translation Machine Translation NMT+1

MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning

2026-07-13 · Ayoung Lee, Ryan Kwon, Yunxiang Zhang, Yuxuan Liu 외 hf

Language models are increasingly used for moral decision-making across diverse linguistic and cultural contexts, yet existing work overlooks multilinguality on three aspects: 1) multilingual evaluation benchmarks use dir…

Align Once, Benefit Multilingually: Enforcing Multilingual Consistency for LLM Safety Alignment

2026-02-18 · Yuyan Bu, Xiaohao Liu, ZhaoXing Ren, Yaodong Yang 외 arxiv

The widespread deployment of large language models (LLMs) across linguistic communities necessitates reliable multilingual safety alignment. However, recent efforts to extend alignment to other languages often require su…