paper-with-me

홈 › Papers

Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?

2025-10-31 · Deokhyung Kang, Seonjeong Hwang, Daehui Kim, Hyounghun Kim, Gary Geunbae Lee arxiv

Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones. While recent efforts have been made to address this gap, its underlying causes remain largely unexplored. In this work, we show that this gap primarily stems from failures in language understanding-specifically, the model's inability to translate multilingual inputs into the language dominating its reasoning traces (typically English). As identifying understanding failures can enable targeted mitigation of the gap, we evaluate a range of detection methods and find that understanding failures are detectable to a meaningful extent, with supervised approaches performing best. Building on this, we propose Selective Translation, a strategy that incorporates an English translation into the initial reasoning trace only when an understanding failure is detected. Experimental results using Qwen3-4B show that Selective Translation substantially bridges the multilingual reasoning gap, achieving near full-translation performance while translating only about 20% of inputs. Together, our results show that failures in language understanding are the primary driver of the multilingual reasoning gap and can be detected and selectively mitigated, clarifying its origin and suggesting a path toward more equitable multilingual reasoning. Our code and data are publicly available at https://github.com/deokhk/RLM_analysis

📄 PDF Abstract BibTeX arXiv:2510.27269

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

What Makes Good Multilingual Reasoning? Disentangling Reasoning Traces with Measurable Features

2026-04-06 · Dayeon Ki, Kevin Duh, Marine Carpuat arxiv

Large Reasoning Models (LRMs) still exhibit large performance gaps between English and other languages, yet much current work assumes these gaps can be closed simply by making reasoning in every language resemble English…

Mathematical Reasoning

DEPART: DEcomposing PARiTy across Multilingual LLMs

2026-05-27 · Manan Uppadhyay, Prashant Kodali, Pranjal Chitale, Reshma Ramaprasad 외 arxiv

Multilingual Large Language Models (mLLMs) leaderboards report per-language accuracy but rarely explain why disparities emerge, leaving systemic biases unattributed and offering practitioners no actionable levers. We fir…

Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning

2025-07-07 · Jaedong Hwang, Kumar Tanmay, Seok-Jin Lee, Ayush Agrawal 외

Large Language Models (LLMs) have achieved strong performance in domains like mathematics, factual QA, and code generation, yet their multilingual reasoning capabilities in these tasks remain underdeveloped. Especially f…

Code Generationreinforcement-learningReinforcement Learning

Learning When to Translate for Multilingual Reasoning

2026-06-01 · Deokhyung Kang, Hyounghun Kim, Gary Geunbae Lee arxiv

Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, but still exhibit substantial multilingual reasoning gaps, largely due to language-understanding failures in non-English inputs. Eng…

Reinforcement Learning

MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI Agents

2025-11-30 · Ruihan Chen, Qiming Li, Xiaocheng Feng, Weihong Zhong 외 arxiv

Large Vision-Language Models (LVLMs) have shown strong potential as multilingual Graphical User Interface (GUI) agents, as evidenced by existing GUI benchmarks. However, these benchmarks exhibit two primary limitations: …