paper-with-me

Papers

Evolutionary RL for Container Loading

2018-05-17 · S Saikia, R Verma, P Agarwal, G Shroff, L Vig, A Srinivasan

Loading the containers on the ship from a yard, is an impor- tant part of port operations. Finding the optimal sequence for the loading of containers, is known to be computationally hard and is an example of combinatorial optimization, which leads to the application of simple heuristics in practice. In this paper, we propose an approach which uses a mix of Evolutionary Strategies and Reinforcement Learning (RL) tech- niques to find an approximation of the optimal solution. The RL based agent uses the Policy Gradient method, an evolutionary reward strategy and a Pool of good (not-optimal) solutions to find the approximation. We find that the RL agent learns near-optimal solutions that outperforms the heuristic solutions. We also observe that the RL agent assisted with a pool generalizes better for unseen problems than an RL agent without a pool. We present our results on synthetic data as well as on subsets of real-world problems taken from container terminal. The results validate that our approach does comparatively better than the heuristics solutions available, and adapts to unseen problems better.

📄 PDF Abstract BibTeX arXiv:1805.06664

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Optimizing Container Loading and Unloading through Dual-Cycling and Dockyard Rehandle Reduction Using a Hybrid Genetic Algorithm

2024-06-12 · Md. Mahfuzur Rahman, Md Abrar Jahin, Md. Saiful Islam, M. F. Mridha

This paper addresses the optimization of container unloading and loading operations at ports, integrating quay-crane dual-cycling with dockyard rehandle minimization. We present a unified model encompassing both operatio…

Scheduling

Fast or Cheap: Time and Energy Optimal Control of Ship-to-Shore Cranes

2023-04-18 · Filipe Marques Barbosa, Anton Kullberg, Johan Löfberg

This paper addresses the trade-off between time- and energy-efficiency for the problem of loading and unloading a ship. Container height constraints and energy consumption and regeneration are dealt with. We build upon a…

Computer Vision-Based Early Detection of Container Loss at Sea

2026-04-27 · Vishakha Lall, Capt. Stanley S Pinto, Capt. Chu Xing Peng, Wu Kaiwen arxiv

Containerised shipping underpins global trade, yet container loss at sea remains a persistent safety, environmental, and economic challenge. Despite compliance with Cargo Securing Manuals, dynamic maritime conditions suc…

Object SegmentationObject Tracking

Evolutionary Approach for the Containers Bin-Packing Problem

2013-06-03 · R. Kammarti, I. Ayachi, M. Ksouri, P. Borne

This paper deals with the resolution of combinatorial optimization problems, particularly those concerning the maritime transport scheduling. We are interested in the management platforms in a river port and more specifi…

Combinatorial OptimizationManagementScheduling

Cloud-Assisted Remote Control for Aerial Robots: From Theory to Proof-of-Concept Implementation

2025-09-04 · Achilleas Santi Seisa, Viswa Narayanan Sankaranarayanan, Gerasimos Damigos, Sumeet Gajanan Satpute 외 arxiv

Cloud robotics has emerged as a promising technology for robotics applications due to its advantages of offloading computationally intensive tasks, facilitating data sharing, and enhancing robot coordination. However, in…