paper-with-me

홈 › Papers

OR-Toolformer: Modeling and Solving Operations Research Problems with Tool Augmented Large Language Models

2025-09-24 · Jianzhang Zhang, Jialong Zhou, Chuang Liu arxiv

Large language models (LLMs) demonstrate strong mathematical reasoning, but reliance on closed-source APIs for OR tasks raises privacy concerns, and training open-source models from scratch incurs high compute costs. We introduce OR-Toolformer, which fine-tunes Llama-3.1-8B-Instruct with a semi-automatic data synthesis pipeline that generates diverse OR problem-answer pairs and augments the model with external solvers to produce API calls. On three of four standard benchmarks, OR-Toolformer achieves up to 80.1% execution accuracy, exceeding size-matched baselines by over 4.3%. In zero-shot evaluation on two unseen OR problem types, it attains 54% average accuracy, a 21 percentage-point improvement over the strongest baseline. These findings validate the efficacy of tool-augmented fine-tuning LLMs for accurate and generalizable OR problem modeling and solving.

📄 PDF Abstract BibTeX arXiv:2510.01253

Code (0)

등록된 구현이 없습니다.

Tasks

Mathematical Reasoning

Similar Papers 제목 키워드 기반

Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPT

2023-04-10 · Jiawei Zhang

In this paper, we aim to develop a large language model (LLM) with the reasoning ability on complex graph data. Currently, LLMs have achieved very impressive performance on various natural language learning tasks, extens…

Graph LearningKnowledge GraphsLanguage ModellingLarge Language Model+1

Toolformer: Language Models Can Teach Themselves to Use Tools

2023-02-09 · NeurIPS 2023 11 · Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu 외

Language models (LMs) exhibit remarkable abilities to solve new tasks from just a few examples or textual instructions, especially at scale. They also, paradoxically, struggle with basic functionality, such as arithmetic…

Language ModelingLanguage Modelling

Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Dataset Augmented by ChatGPT

2023-04-10 · Preprint 2023 4 · Jiawei Zhang

In this paper, we aim to develop a large language model (LLM) with the reasoning ability on complex graph data. Currently, LLMs have achieved very impressive performance on various natural language learning tasks, extens…

Community DetectionGraph ClassificationGraph LearningIn-Context Learning+5

Highlighting Named Entities in Input for Auto-Formulation of Optimization Problems

2022-12-26 · Neeraj Gangwar, Nickvash Kani

Operations research deals with modeling and solving real-world problems as mathematical optimization problems. While solving mathematical systems is accomplished by analytical software, formulating a problem as a set of …

OR-LLM-Agent: Automating Modeling and Solving of Operations Research Optimization Problem with Reasoning Large Language Model

2025-03-13 · BoWen Zhang, Pengcheng Luo

Operations Research (OR) has been widely applied in various fields such as resource allocation, production planning, and supply chain management. However, addressing real-world OR problems requires OR experts to perform …

AI AgentLanguage ModelingLanguage ModellingLarge Language Model