홈 › Papers

A Benchmark Study of Deep Reinforcement Learning Algorithms for the Container Stowage Planning Problem

2025-10-02 · Yunqi Huang, Nishith Chennakeshava, Alexis Carras, Vladislav Neverov, Wei Liu, Aske Plaat, Yingjie Fan arxiv

Container stowage planning (CSPP) is a critical component of maritime transportation and terminal operations, directly affecting supply chain efficiency. Owing to its complexity, CSPP has traditionally relied on human expertise. While reinforcement learning (RL) has recently been applied to CSPP, systematic benchmark comparisons across different algorithms remain limited. To address this gap, we develop a Gym environment that captures the fundamental features of CSPP and extend it to include crane scheduling in both multi-agent and single-agent formulations. Within this framework, we evaluate five RL algorithms: DQN, QR-DQN, A2C, PPO, and TRPO under multiple scenarios of varying complexity. The results reveal distinct performance gaps with increasing complexity, underscoring the importance of algorithm choice and problem formulation for CSPP. Overall, this paper benchmarks multiple RL methods for CSPP while providing a reusable Gym environment with crane scheduling, thus offering a foundation for future research and practical deployment in maritime logistics.

📄 PDF Abstract BibTeX arXiv:2510.02589

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

AI2STOW: End-to-End Deep Reinforcement Learning to Construct Master Stowage Plans under Demand Uncertainty

2025-04-06 · Jaike van Twiller, Djordje Grbic, Rune Møller Jensen

The worldwide economy and environmental sustainability depend on eff icient and reliable supply chains, in which container shipping plays a crucial role as an environmentally friendly mode of transport. Liner shipping co…

Computational Efficiency Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Navigating Demand Uncertainty in Container Shipping: Deep Reinforcement Learning for Enabling Adaptive and Feasible Master Stowage Planning

2025-02-18 · Jaike van Twiller, Yossiri Adulyasak, Erick Delage, Djordje Grbic 외

Reinforcement learning (RL) has shown promise in solving various combinatorial optimization problems. However, conventional RL faces challenges when dealing with real-world constraints, especially when action space feasi…

Combinatorial Optimization Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Reconfiguring Shortest Paths in Graphs

2021-12-14 · Kshitij Gajjar, Agastya Vibhuti Jha, Manish Kumar, Abhiruk Lahiri

Reconfiguring two shortest paths in a graph means modifying one shortest path to the other by changing one vertex at a time so that all the intermediate paths are also shortest paths. This problem has several natural app…

ContainerGym: A Real-World Reinforcement Learning Benchmark for Resource Allocation

2023-07-06 · Abhijeet Pendyala, Justin Dettmer, Tobias Glasmachers, Asma Atamna

We present ContainerGym, a benchmark for reinforcement learning inspired by a real-world industrial resource allocation task. The proposed benchmark encodes a range of challenges commonly encountered in real-world sequen…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Containerized Distributed Value-Based Multi-Agent Reinforcement Learning

2021-10-15 · Siyang Wu, Tonghan Wang, Chenghao Li, Yang Hu 외

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique chall…

Blocking Management Multi-agent Reinforcement Learning reinforcement-learning+4