paper-with-me

홈 › Papers

Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework

2026-04-22 · Chenyuan Zhang, Qiguang Chen, Xie Chen, Zhuotao Tian, Bowen Xing, Meishan Zhang, Libo Qin, Baotian Hu, Min Zhang arxiv

Cross-lingual chain-of-thought (XCoT) with self-consistency markedly enhances multilingual reasoning, yet existing methods remain costly due to extensive sampling of full trajectories across languages. Moreover, multilingual LLM representations vary strongly by language, hindering direct feature comparisons and effective pruning. Motivated by this, we introduce UL-XCoT, the first efficient unified logic cross-lingual reasoning framework that minimizes redundancy in token usage and latency, yielding the greatest efficiency under limited sampling budgets during inference. Specifically, UL-XCoT (1) achieves less languages by selecting, per query, a small candidate language set in a language-invariant unified logic space, (2) enables less tokens by monitoring logic-space trajectory dynamics during decoding to prune low-quality reasoning paths, and (3) aggregates the remaining high-quality trajectories via voting. Experiments on PolyMath across 18 languages and MMLU-ProX-Lite across 29 languages with DeepSeek-R1-DistillQwen-7B demonstrate that UL-XCoT achieves competitive accuracy while sharply cutting over 50% decoding token cost versus prior sampling baselines. UL-XCoT also delivers more stable gains on low-resource languages, underscoring consistently superior robustness where standard XCoT self-consistency method fails.

📄 PDF Abstract BibTeX arXiv:2604.20090

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Comparing morphological complexity of Spanish, Otomi and Nahuatl

2018-08-13 · WS 2018 8 · Ximena Gutierrez-Vasques, Victor Mijangos

We use two small parallel corpora for comparing the morphological complexity of Spanish, Otomi and Nahuatl. These are languages that belong to different linguistic families, the latter are low-resourced. We take into acc…

Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models

2023-05-23 · Orevaoghene Ahia, Sachin Kumar, Hila Gonen, Jungo Kasai 외

Language models have graduated from being research prototypes to commercialized products offered as web APIs, and recent works have highlighted the multilingual capabilities of these products. The API vendors charge thei…

AllFairnessLanguage ModelingLanguage Modelling

Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokens

2025-04-20 · CVPR 2025 1 · Kaihang Pan, Wang Lin, Zhongqi Yue, Tenglong Ao 외

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches re…

AttributeImage Generation

Less Is More: Fast and Accurate Reasoning with Cross-Head Unified Sparse Attention

2025-08-09 · Lijie Yang, Zhihao Zhang, Arti Jain, Shijie Cao 외 arxiv

Large reasoning models achieve strong performance through test-time scaling, but this incurs substantial computational overhead due to long decoding from short prompts. While sparse attention can reduce latency and memor…

Language-Independent Tokenisation Rivals Language-Specific Tokenisation for Word Similarity Prediction

2020-02-25 · LREC 2020 5 · Danushka Bollegala, Ryuichi Kiryo, Kosuke Tsujino, Haruki Yukawa

Language-independent tokenisation (LIT) methods that do not require labelled language resources or lexicons have recently gained popularity because of their applicability in resource-poor languages. Moreover, they compac…

Semantic SimilaritySemantic Textual SimilarityvalidWord Embeddings+1