Obstacle Avoidance for UAS in Continuous Action Space Using Deep Reinforcement Learning

2021-11-13 · Jueming Hu, Xuxi Yang, Weichang Wang, Peng Wei, Lei Ying, Yongming Liu

Obstacle avoidance for small unmanned aircraft is vital for the safety of future urban air mobility (UAM) and Unmanned Aircraft System (UAS) Traffic Management (UTM). There are many techniques for real-time robust drone guidance, but many of them solve in discretized airspace and control, which would require an additional path smoothing step to provide flexible commands for UAS. To provide a safe and efficient computational guidance of operations for unmanned aircraft, we explore the use of a deep reinforcement learning algorithm based on Proximal Policy Optimization (PPO) to guide autonomous UAS to their destinations while avoiding obstacles through continuous control. The proposed scenario state representation and reward function can map the continuous state space to continuous control for both heading angle and speed. To verify the performance of the proposed learning framework, we conducted numerical experiments with static and moving obstacles. Uncertainties associated with the environments and safety operation bounds are investigated in detail. Results show that the proposed model can provide accurate and robust guidance and resolve conflict with a success rate of over 99%.

📄 PDF Abstract BibTeX arXiv:2111.07037

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous ControlDeep Reinforcement LearningManagement reinforcement-learning Reinforcement Learning (RL)

Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learning

2021-03-08 · Patrick Wenzel, Torsten Schön, Laura Leal-Taixé, Daniel Cremers

Obstacle avoidance is a fundamental and challenging problem for autonomous navigation of mobile robots. In this paper, we consider the problem of obstacle avoidance in simple 3D environments where the robot has to solely…

Atari Games Autonomous Navigation continuous-control Continuous Control+5

Dynamic Interval Restrictions on Action Spaces in Deep Reinforcement Learning for Obstacle Avoidance

2023-06-13 · Tim Grams

Deep reinforcement learning algorithms typically act on the same set of actions. However, this is not sufficient for a wide range of real-world applications where different subsets are available at each step. In this the…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Deep Reinforcement Learning-based Obstacle Avoidance for Robot Movement in Warehouse Environments

2024-09-23 · Keqin Li, Jiajing Chen, Denzhi Yu, Tao Dajun 외

At present, in most warehouse environments, the accumulation of goods is complex, and the management personnel in the control of goods at the same time with the warehouse mobile robot trajectory interaction, the traditio…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Fast Trajectory Planner with a Reinforcement Learning-based Controller for Robotic Manipulators

2025-09-22 · Yongliang Wang, Hamidreza Kasaei arxiv

Generating obstacle-free trajectories for robotic manipulators in unstructured and cluttered environments remains a significant challenge. Existing motion planning methods often require additional computational effort to…

Reinforcement Learning Trajectory Planning Motion Planning

Composable Model-Free RL for Navigation with Input-Affine Systems

2026-02-13 · Xinhuan Sang, Abdelrahman Abdelgawad, Roberto Tron arxiv

As autonomous robots move into complex, dynamic real-world environments, they must learn to navigate safely in real time, yet anticipating all possible behaviors is infeasible. We propose a composable, model-free reinfor…

Reinforcement Learning Collision Avoidance