paper-with-me

Papers

Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning

2023-02-11 · Jiayu Liu, Zhenya Huang, ChengXiang Zhai, Qi Liu

Mathematical reasoning is one of the crucial abilities of general artificial intelligence, which requires machines to master mathematical logic and knowledge from solving problems. However, existing approaches are not transparent (thus not interpretable) in terms of what knowledge has been learned and applied in the reasoning process. In this paper, we propose a general Learning by Applying (LeAp) framework to enhance existing models (backbones) in a principled way by explicit knowledge learning. In LeAp, we perform knowledge learning in a novel problem-knowledge-expression paradigm, with a Knowledge Encoder to acquire knowledge from problem data and a Knowledge Decoder to apply knowledge for expression reasoning. The learned mathematical knowledge, including word-word relations and word-operator relations, forms an explicit knowledge graph, which bridges the knowledge "learning" and "applying" organically. Moreover, for problem solving, we design a semantics-enhanced module and a reasoning-enhanced module that apply knowledge to improve the problem comprehension and symbol reasoning abilities of any backbone, respectively. We theoretically prove the superiority of LeAp's autonomous learning mechanism. Experiments on three real-world datasets show that LeAp improves all backbones' performances, learns accurate knowledge, and achieves a more interpretable reasoning process.

📄 PDF Abstract BibTeX arXiv:2302.05717

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderMathematical Reasoning

Similar Papers 제목 키워드 기반

LexPam: Legal Procedure Awareness-Guided Mathematical Reasoning

2025-04-03 · Kepu Zhang, Guofu Xie, Weijie Yu, Mingyue Xu 외

The legal mathematical reasoning ability of LLMs is crucial when applying them to real-world scenarios, as it directly affects the credibility of the LLM. While existing legal LLMs can perform general judicial question a…

Mathematical ReasoningQuestion Answering

A Survey on Large Language Models for Mathematical Reasoning

2025-06-10 · Peng-Yuan Wang, Tian-Shuo Liu, Chenyang Wang, Yi-Di Wang 외

Mathematical reasoning has long represented one of the most fundamental and challenging frontiers in artificial intelligence research. In recent years, large language models (LLMs) have achieved significant advances in t…

Answer GenerationMathematical ReasoningSurvey

Does Learning Mathematical Problem-Solving Generalize to Broader Reasoning?

2025-07-06 · Ruochen Zhou, Minrui Xu, Shiqi Chen, Junteng Liu 외 arxiv

There has been a growing interest in enhancing the mathematical problem-solving (MPS) capabilities of large language models. While the majority of research efforts concentrate on creating specialized models to solve math…

Reinforcement LearningContinual Pretraining

KG-Augmented Executable CoT for Mathematical Coding

2025-08-06 · Xingyu Chen, Junxiu An, Jun Guo, Li Wang 외 arxiv

In recent years, large language models (LLMs) have excelled in natural language processing tasks but face significant challenges in complex reasoning tasks such as mathematical reasoning and code generation. To address t…

Mathematical ReasoningKnowledge GraphsCode Generation

MathFusion: Enhancing Mathematic Problem-solving of LLM through Instruction Fusion

2025-03-20 · Qizhi Pei, Lijun Wu, Zhuoshi Pan, Yu Li 외

Large Language Models (LLMs) have shown impressive progress in mathematical reasoning. While data augmentation is promising to enhance mathematical problem-solving ability, current approaches are predominantly limited to…

Data AugmentationMathematical Problem-SolvingMathematical Reasoning