paper-with-me

Papers

LLM Reasoning Engine: Specialized Training for Enhanced Mathematical Reasoning

2024-12-28 · Shuguang Chen, Guang Lin

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical reasoning skills. Existing approaches to address this challenge often rely on ensemble methods and suffer from the problem of data scarcity in target domains. In this work, we present a novel method to enhance LLMs' capabilities in mathematical reasoning tasks. Motivated by the need to bridge this gap, our approach incorporates a question paraphrase strategy, which aims at diversifying the linguistic forms of mathematical questions to improve generalization. Additionally, specialized training objectives are employed to guide the model's learning process, focusing on enhancing its understanding of mathematical concepts and reasoning processes. We conduct experiments on four datasets using different LLMs, and demonstrate the effectiveness of our approach in improving LLMs' performance on mathematical reasoning tasks. Our findings underscore the significance of our methodology in the advancement of large language models and its potential implications for real-world applications that require mathematical reasoning abilities.

📄 PDF Abstract BibTeX arXiv:2412.20227

Code (0)

등록된 구현이 없습니다.

Tasks

Mathematical Reasoning

Similar Papers 제목 키워드 기반

EngTrace: A Symbolic Benchmark for Verifiable Process Supervision of Engineering Reasoning

2025-11-03 · Ayesha Gull, Muhammad Usman Safder, Rania Elbadry, Fan Zhang 외 arxiv

Large Language Models (LLMs) are increasingly entering specialized, safety-critical engineering workflows governed by strict quantitative standards and immutable physical laws, making rigorous evaluation of their reasoni…

EngiBench: A Benchmark for Evaluating Large Language Models on Engineering Problem Solving

2025-09-22 · Xiyuan Zhou, Xinlei Wang, Yirui He, Yang Wu 외 arxiv

Large language models (LLMs) have shown strong performance on mathematical reasoning under well-defined conditions. However, real-world engineering problems involve uncertainty, context, and open-ended settings that exte…

Mathematical Reasoning

MAMUT: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training

2025-02-28 · Jonathan Drechsel, Anja Reusch, Steffen Herbold

Mathematical formulas are a fundamental and widely used component in various scientific fields, serving as a universal language for expressing complex concepts and relationships. While state-of-the-art transformer models…

Language ModelingLanguage ModellingMath

Does Learning Mathematical Problem-Solving Generalize to Broader Reasoning?

2025-07-06 · Ruochen Zhou, Minrui Xu, Shiqi Chen, Junteng Liu 외 arxiv

There has been a growing interest in enhancing the mathematical problem-solving (MPS) capabilities of large language models. While the majority of research efforts concentrate on creating specialized models to solve math…

Reinforcement LearningContinual Pretraining

X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains

2025-05-06 · Qianchu Liu, Sheng Zhang, Guanghui Qin, Timothy Ossowski 외

Recent proprietary models (e.g., o3) have begun to demonstrate strong multimodal reasoning capabilities. Yet, most existing open-source research concentrates on training text-only reasoning models, with evaluations limit…

Multimodal Reasoning