paper-with-me

홈 › Papers

Reinforcement Learning-Based Automatic Berthing System

2021-12-03 · Daesoo Lee

Previous studies on automatic berthing systems based on artificial neural network (ANN) showed great berthing performance by training the ANN with ship berthing data as training data. However, because the ANN requires a large amount of training data to yield robust performance, the ANN-based automatic berthing system is somewhat limited due to the difficulty in obtaining the berthing data. In this study, to overcome this difficulty, the automatic berthing system based on one of the reinforcement learning (RL) algorithms, proximal policy optimization (PPO), is proposed because the RL algorithms can learn an optimal control policy through trial-and-error by interacting with a given environment and does not require any pre-obtained training data, where the control policy in the proposed PPO-based automatic berthing system controls revolutions per second (RPS) and rudder angle of a ship. Finally, it is shown that the proposed PPO-based automatic berthing system eliminates the need for obtaining the training dataset and shows great potential for the actual berthing application.

📄 PDF Abstract BibTeX arXiv:2112.01879

Code (1)

danelee2601/rl-based-automatic-berthing 공식 구현

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Collision probability reduction method for tracking control in automatic docking / berthing using reinforcement learning

2022-12-13 · Kouki Wakita, Youhei Akimoto, Dimas M. Rachman, Yoshiki Miyauchi 외

Automation of berthing maneuvers in shipping is a pressing issue as the berthing maneuver is one of the most stressful tasks seafarers undertake. Berthing control problems are often tackled via tracking a predefined traj…

Reinforcement Learning from Demonstrations by Novel Interactive Expert and Application to Automatic Berthing Control Systems for Unmanned Surface Vessel

2022-02-23 · Haoran Zhang, Chenkun Yin, Yanxin Zhang, Shangtai Jin 외

In this paper, two novel practical methods of Reinforcement Learning from Demonstration (RLfD) are developed and applied to automatic berthing control systems for Unmanned Surface Vessel. A new expert data generation met…

Model Predictive Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Data Augmentation Methods of Dynamic Model Identification for Harbor Maneuvers using Feedforward Neural Network

2023-05-30 · Kouki Wakita, Yoshiki Miyauchi, Youhei Akimoto, Atsuo Maki

A dynamic model for an automatic berthing and unberthing controller has to estimate harbor maneuvers, which include berthing, unberthing, approach maneuvers to berths, and entering and leaving the port. When the dynamic …

Data Augmentation

System Parameter Exploration of Ship Maneuvering Model for Automatic Docking / Berthing using CMA-ES

2021-11-11 · Yoshiki Miyauchi, Atsuo Maki, Naoya Umeda, Dimas M. Rachman 외

Accurate maneuvering estimation is essential to establish autonomous berthing control. The system-based mathematical model is widely used to estimate the ship's maneuver. Commonly, the system parameters of the mathematic…

global-optimization

On Neural Network Identification for Low-Speed Ship Maneuvering Model

2021-11-11 · Kouki Wakita, Atsuo Maki, Umeda Naoya, Yoshiki Miyauchi 외

Several studies on ship maneuvering models have been conducted using captive model tests or computational fluid dynamics (CFD) and physical models, such as the maneuvering modeling group (MMG) model. A new system identif…

Network Identification