paper-with-me

Papers

X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains

2025-05-06 · Qianchu Liu, Sheng Zhang, Guanghui Qin, Timothy Ossowski, Yu Gu, Ying Jin, Sid Kiblawi, Sam Preston, Mu Wei, Paul Vozila, Tristan Naumann, Hoifung Poon

Recent proprietary models (e.g., o3) have begun to demonstrate strong multimodal reasoning capabilities. Yet, most existing open-source research concentrates on training text-only reasoning models, with evaluations limited to mainly mathematical and general-domain tasks. Therefore, it remains unclear how to effectively extend reasoning capabilities beyond text input and general domains. This paper explores a fundamental research question: Is reasoning generalizable across modalities and domains? Our findings support an affirmative answer: General-domain text-based post-training can enable such strong generalizable reasoning. Leveraging this finding, we introduce X-Reasoner, a vision-language model post-trained solely on general-domain text for generalizable reasoning, using a two-stage approach: an initial supervised fine-tuning phase with distilled long chain-of-thoughts, followed by reinforcement learning with verifiable rewards. Experiments show that X-Reasoner successfully transfers reasoning capabilities to both multimodal and out-of-domain settings, outperforming existing state-of-the-art models trained with in-domain and multimodal data across various general and medical benchmarks (Figure 1). Additionally, we find that X-Reasoner's performance in specialized domains can be further enhanced through continued training on domain-specific text-only data. Building upon this, we introduce X-Reasoner-Med, a medical-specialized variant that achieves new state of the art on numerous text-only and multimodal medical benchmarks.

📄 PDF Abstract BibTeX arXiv:2505.03981

Code (0)

등록된 구현이 없습니다.

Tasks

Multimodal Reasoning

Similar Papers 제목 키워드 기반

General-Reasoner: Advancing LLM Reasoning Across All Domains

2025-05-20 · Xueguang Ma, Qian Liu, Dongfu Jiang, Ge Zhang 외

Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs). Particularly, the "Zero" reinforcement learning introduced by Deepseek-R1-Ze…

AllMathMathematical ReasoningMMLU+1

Take A Step Back: Rethinking the Two Stages in Visual Reasoning

2024-07-29 · Mingyu Zhang, Jiting Cai, MingYu Liu, Yue Xu 외

Visual reasoning, as a prominent research area, plays a crucial role in AI by facilitating concept formation and interaction with the world. However, current works are usually carried out separately on small datasets thu…

Logical ReasoningQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)+1

Apriel-1.5-OpenReasoner: RL Post-Training for General-Purpose and Efficient Reasoning

2026-04-02 · Rafael Pardinas, Ehsan Kamalloo, David Vazquez, Alexandre Drouin arxiv

Building general-purpose reasoning models using reinforcement learning with verifiable rewards (RLVR) across diverse domains has been widely adopted by frontier open-weight models. However, their training recipes and dom…

Reinforcement LearningInstruction FollowingCode Generation

RuleReasoner: Reinforced Rule-based Reasoning via Domain-aware Dynamic Sampling

2025-06-10 · Yang Liu, Jiaqi Li, Zilong Zheng

Rule-based reasoning has been acknowledged as one of the fundamental problems in reasoning, while deviations in rule formats, types, and complexity in real-world applications pose severe challenges. Recent studies have s…

Computational EfficiencyReinforcement Learning (RL)

OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe

2025-11-20 · Kaichen Zhang, Keming Wu, Zuhao Yang, Bo Li 외 arxiv

Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproduc…

Reinforcement LearningMultimodal ReasoningVisual Reasoning