paper-with-me

홈 › Papers

Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Learning

2025-05-09 · Hang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems. Although existing methods have extended the reasoning capabilities of LLMs through structured paradigms, these approaches often rely on task-specific prompts and predefined reasoning processes, which constrain their flexibility and generalizability. To address these limitations, we propose a novel framework that leverages graph learning to enable more flexible and adaptive reasoning capabilities for LLMs. Specifically, this approach models the reasoning process of a problem as a graph and employs LLM-based graph learning to guide the adaptive generation of each reasoning step. To further enhance the adaptability of the model, we introduce a Graph Neural Network (GNN) module to perform representation learning on the generated reasoning process, enabling real-time adjustments to both the model and the prompt. Experimental results demonstrate that this method significantly improves reasoning performance across multiple tasks without requiring additional training or task-specific prompt design. Code can be found in https://github.com/zch65458525/L2T.

📄 PDF Abstract BibTeX arXiv:2505.06321

Code (1)

zch65458525/l2t 공식 구현 pytorch

Tasks

Graph LearningGraph Neural NetworkRepresentation Learning

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

BRiTE: Bootstrapping Reinforced Thinking Process to Enhance Language Model Reasoning

2025-01-31 · Han Zhong, Yutong Yin, Shenao Zhang, Xiaojun Xu 외

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks, yet generating reliable reasoning processes remains a significant challenge. We present a unified probabilistic framework…

Language ModelingLanguage ModellingMath

Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMs

2026-02-28 · Jie Cao, Tianwei Lin, Zhenxuan Fan, Bo Yuan 외 arxiv

Long chain-of-thought~(CoT) has become a dominant paradigm for enhancing the reasoning capability of large reasoning models~(LRMs); however, the performance gains often come with a substantial increase in reasoning budge…

Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning

2025-10-27 · Shijian Wang, Jiarui Jin, Xingjian Wang, Linxin Song 외 arxiv

Recent advances in image reasoning methods, particularly "Thinking with Images", have demonstrated remarkable success in Multimodal Large Language Models (MLLMs); however, this dynamic reasoning paradigm has not yet been…

Reinforcement Learning

ThinkSwitcher: When to Think Hard, When to Think Fast

2025-05-20 · Guosheng Liang, Longguang Zhong, ZiYi Yang, Xiaojun Quan

Large reasoning models (LRMs) excel at solving complex tasks by leveraging long chain-of-thought (CoT) reasoning. However, this often leads to overthinking on simple tasks, resulting in unnecessary computational overhead…

BARD: budget-aware reasoning distillation

2025-11-03 · Lujie Niu, Lei Shen, Yi Jiang, Caixia Yuan 외 arxiv

While long Chain-of-Thought (CoT) distillation effectively transfers reasoning capability to smaller language models, the reasoning process often remains redundant and computational budget uncontrollable, leading to inef…

Computational EfficiencyReinforcement Learning