Multi-Agent Path Planning based on MPC and DDPG

2021-02-26 · Junxiao Xue, Xiangyan Kong, Bowei Dong, Mingliang Xu

The problem of mixed static and dynamic obstacle avoidance is essential for path planning in highly dynamic environment. However, the paths formed by grid edges can be longer than the true shortest paths in the terrain since their headings are artificially constrained. Existing methods can hardly deal with dynamic obstacles. To address this problem, we propose a new algorithm combining Model Predictive Control (MPC) with Deep Deterministic Policy Gradient (DDPG). Firstly, we apply the MPC algorithm to predict the trajectory of dynamic obstacles. Secondly, the DDPG with continuous action space is designed to provide learning and autonomous decision-making capability for robots. Finally, we introduce the idea of the Artificial Potential Field to set the reward function to improve convergence speed and accuracy. We employ Unity 3D to perform simulation experiments in highly uncertain environment such as aircraft carrier decks and squares. The results show that our method has made great improvement on accuracy by 7%-30% compared with the other methods, and on the length of the path and turning angle by reducing 100 units and 400-450 degrees compared with DQN (Deep Q Network), respectively.

📄 PDF Abstract BibTeX arXiv:2102.13283

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingModel Predictive ControlUnity

Methods 이 논문이 사용한 방법론

Weight Decay 설명 없음

Adam 설명 없음

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Batch Normalization 설명 없음

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

A Comparison of Reinforcement Learning and Optimal Control Methods for Path Planning

2026-04-14 · Qiang Le, Yaguang Yang, Isaac E. Weintraub arxiv

Path-planning for autonomous vehicles in threat-laden environments is a fundamental challenge. While traditional optimal control methods can find ideal paths, the computational time is often too slow for real-time decisi…

Reinforcement Learning Autonomous Vehicles

Path Planning Using Deep Deterministic Policy Gradient: A Reinforcement Learning Approach

2026-06-05 · Qiang Le, Yaguang Yang, Isaac E. Weintraub arxiv

Path-planning for autonomous vehicles in threat-laden environments is a fundamental challenge because the problem is nonlinear and nonconvex even in simplest scenarios. While traditional optimal control methods can be us…

Reinforcement Learning Autonomous Vehicles

DNN Task Assignment in UAV Networks: A Generative AI Enhanced Multi-Agent Reinforcement Learning Approach

2024-11-13 · Xin Tang, Qian Chen, Wenjie Weng, Binhan Liao 외

Unmanned Aerial Vehicles (UAVs) possess high mobility and flexible deployment capabilities, prompting the development of UAVs for various application scenarios within the Internet of Things (IoT). The unique capabilities…

Denoising Multi-agent Reinforcement Learning

Deep Deterministic Path Following

2021-04-13 · Georg Hess, William Ljungbergh

This paper deploys the Deep Deterministic Policy Gradient (DDPG) algorithm for longitudinal and lateral control of a simulated car to solve a path following task. The DDPG agent was implemented using PyTorch and trained …

Energy Management of Multi-mode Plug-in Hybrid Electric Vehicle using Multi-agent Deep Reinforcement Learning

2023-03-16 · Min Hua, Cetengfei Zhang, Fanggang Zhang, Zhi Li 외

The recently emerging multi-mode plug-in hybrid electric vehicle (PHEV) technology is one of the pathways making contributions to decarbonization, and its energy management requires multiple-input and multipleoutput (MIM…

Deep Reinforcement Learning energy management Management