paper-with-me

Papers

A Large Language Model-Enhanced Q-learning for Capacitated Vehicle Routing Problem with Time Windows

2025-05-09 · Linjiang Cao, Maonan Wang, Xi Xiong

The Capacitated Vehicle Routing Problem with Time Windows (CVRPTW) is a classic NP-hard combinatorial optimization problem widely applied in logistics distribution and transportation management. Its complexity stems from the constraints of vehicle capacity and time windows, which pose significant challenges to traditional approaches. Advances in Large Language Models (LLMs) provide new possibilities for finding approximate solutions to CVRPTW. This paper proposes a novel LLM-enhanced Q-learning framework to address the CVRPTW with real-time emergency constraints. Our solution introduces an adaptive two-phase training mechanism that transitions from the LLM-guided exploration phase to the autonomous optimization phase of Q-network. To ensure reliability, we design a three-tier self-correction mechanism based on the Chain-of-Thought (CoT) for LLMs: syntactic validation, semantic verification, and physical constraint enforcement. In addition, we also prioritized replay of the experience generated by LLMs to amplify the regulatory role of LLMs in the architecture. Experimental results demonstrate that our framework achieves a 7.3\% average reduction in cost compared to traditional Q-learning, with fewer training steps required for convergence.

📄 PDF Abstract BibTeX arXiv:2505.06178

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationLanguage ModelingLanguage ModellingLarge Language ModelQ-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Metaheuristic Enhanced with Feature-Based Guidance and Diversity Management for Solving the Capacitated Vehicle Routing Problem

2024-07-30 · Bachtiar Herdianto, Romain Billot, Flavien Lucas, Marc Sevaux

We propose a metaheuristic algorithm enhanced with feature-based guidance that is designed to solve the Capacitated Vehicle Routing Problem (CVRP). To formulate the proposed guidance, we developed and explained a supervi…

DiversityManagement

Multi-GPU parallel memetic algorithm for capacitated vehicle routing problem

2014-01-21 · Michał Karpiński, Maciej Pacut

The goal of this paper is to propose and test a new memetic algorithm for the capacitated vehicle routing problem in parallel computing environment. In this paper we consider simple variation of vehicle routing problem i…

GPU

Learning to Deliver: a Foundation Model for the Montreal Capacitated Vehicle Routing Problem

2024-02-28 · Samuel J. K. Chin, Matthias Winkenbach, Akash Srivastava

In this paper, we present the Foundation Model for the Montreal Capacitated Vehicle Routing Problem (FM-MCVRP), a novel Deep Learning (DL) model that approximates high-quality solutions to a variant of the Capacitated Ve…

Language ModellingLarge Language Model

Quantum Reinforcement Learning with Transformers for the Capacitated Vehicle Routing Problem

2026-02-05 · Eva Andrés arxiv

This paper addresses the Capacitated Vehicle Routing Problem (CVRP) by comparing classical and quantum Reinforcement Learning (RL) approaches. An Advantage Actor-Critic (A2C) agent is implemented in classical, full quant…

Reinforcement Learning

Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problem

2019-11-21 · André Hottung, Kevin Tierney

Learning how to automatically solve optimization problems has the potential to provide the next big leap in optimization technology. The performance of automatically learned heuristics on routing problems has been steadi…

BIG-bench Machine Learning