AI on the Water: Applying DRL to Autonomous Vessel Navigation

2023-10-23 · Md Shadab Alam, Sanjeev Kumar Ramkumar Sudha, Abhilash Somayajula

Human decision-making errors cause a majority of globally reported marine accidents. As a result, automation in the marine industry has been gaining more attention in recent years. Obstacle avoidance becomes very challenging for an autonomous surface vehicle in an unknown environment. We explore the feasibility of using Deep Q-Learning (DQN), a deep reinforcement learning approach, for controlling an underactuated autonomous surface vehicle to follow a known path while avoiding collisions with static and dynamic obstacles. The ship's motion is described using a three-degree-of-freedom (3-DOF) dynamic model. The KRISO container ship (KCS) is chosen for this study because it is a benchmark hull used in several studies, and its hydrodynamic coefficients are readily available for numerical modelling. This study shows that Deep Reinforcement Learning (DRL) can achieve path following and collision avoidance successfully and can be a potential candidate that may be investigated further to achieve human-level or even better decision-making for autonomous marine vehicles.

📄 PDF Abstract BibTeX arXiv:2310.14938

Code (0)

등록된 구현이 없습니다.

Tasks

Collision Avoidance Decision MakingDeep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Safe Vessel Navigation Visually Aided by Autonomous Unmanned Aerial Vehicles in Congested Harbors and Waterways

2021-08-09 · Jonas le Fevre Sejersen, Rui Pimentel de Figueiredo, Erdal Kayacan

In the maritime sector, safe vessel navigation is of great importance, particularly in congested harbors and waterways. The focus of this work is to estimate the distance between an object of interest and potential obsta…

Semantic Segmentation

Safe Robust Predictive Control-based Motion Planning of Automated Surface Vessels in Inland Waterways

2025-09-08 · Sajad Ahmadi, Hossein Nejatbakhsh Esfahani, Javad Mohammadpour Velni arxiv

Deploying self-navigating surface vessels in inland waterways offers a sustainable alternative to reduce road traffic congestion and emissions. However, navigating confined waterways presents unique challenges, including…

Collision Avoidance Motion Planning

Visual Trajectory Prediction of Vessels for Inland Navigation

2025-05-01 · Alexander Puzicha, Konstantin Wüstefeld, Kathrin Wilms, Frank Weichert

The future of inland navigation increasingly relies on autonomous systems and remote operations, emphasizing the need for accurate vessel trajectory prediction. This study addresses the challenges of video-based vessel t…

Collision Avoidance object-detection Object Detection Prediction+1

Robust Path Following on Rivers Using Bootstrapped Reinforcement Learning

2023-03-24 · Niklas Paulig, Ostap Ohkrin

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning

Sim2Sea: Sim-to-Real Policy Transfer for Maritime Vessel Navigation in Congested Waters

2026-03-04 · Xinyu Cui, Xuanfa Jin, Xue Yan, Yongcheng Zeng 외 arxiv

Autonomous navigation in congested maritime environments is a critical capability for a wide range of real-world applications. However, it remains an unresolved challenge due to complex vessel interactions and significan…