paper-with-me

홈 › Papers

Multilingual Reasoning Cascades Need More Context

2026-06-25 · Arnav Mazumder, Dengjia Zhang, Shuyue Stella Li, Yulia Tsvetkov, Niyati Bafna arxiv

Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation. We examine the benefits of a simple and training-free intervention: a context-aware translation cascade, which additionally provides the original question, the English translated question, and the reasoning trace to the context of the final translation module. We evaluate gains across nine multilingual benchmarks including various task types, three backbone models, and 285 high-, mid-, and low-resource languages, and demonstrate strong gains for open-ended generation across models and resource regimes. We show that the original language question carries most of the beneficial context. Our study emphasizes the need to better design information flow in machine translation cascades for mitigating error propagation, and provides a simple and actionable default strategy: preserve the original user question until the end of the pipeline.

📄 PDF Abstract BibTeX arXiv:2606.27306

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Translation

Similar Papers 제목 키워드 기반

Extracting and Emulsifying Cultural Explanation to Improve Multilingual Capability of LLMs

2025-03-07 · Hamin Koo, Jaehyung Kim

Large Language Models (LLMs) have achieved remarkable success, but their English-centric training data limits performance in non-English languages, highlighting the need for enhancements in their multilingual capabilitie…

Can LLMs reason over extended multilingual contexts? Towards long-context evaluation beyond retrieval and haystacks

2025-04-17 · Amey Hengle, Prasoon Bajpai, Soham Dan, Tanmoy Chakraborty

Existing multilingual long-context benchmarks, often based on the popular needle-in-a-haystack test, primarily evaluate a model's ability to locate specific information buried within irrelevant texts. However, such a ret…

Epistemic ReasoningLarge Language ModelRetrievalRetrieval-augmented Generation

SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning

2023-09-09 · Bin Wang, Zhengyuan Liu, Xin Huang, Fangkai Jiao 외

We present SeaEval, a benchmark for multilingual foundation models. In addition to characterizing how these models understand and reason with natural language, we also investigate how well they comprehend cultural practi…

Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language Models

2024-08-19 · Amey Hengle, Prasoon Bajpai, Soham Dan, Tanmoy Chakraborty

While recent large language models (LLMs) demonstrate remarkable abilities in responding to queries in diverse languages, their ability to handle long multilingual contexts is unexplored. As such, a systematic evaluation…

8kInformation RetrievalQuestion AnsweringRetrieval

Learning Language-Specific Layers for Multilingual Machine Translation

2023-05-04 · Telmo Pessoa Pires, Robin M. Schmidt, Yi-Hsiu Liao, Stephan Peitz

Multilingual Machine Translation promises to improve translation quality between non-English languages. This is advantageous for several reasons, namely lower latency (no need to translate twice), and reduced error casca…

DecoderMachine TranslationNeural Architecture SearchTranslation