paper-with-me

홈 › Papers

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

2023-04-07 · Xuyang Li, Jianwu Fang, Kai Du, Kuizhi Mei, Jianru Xue

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment. The purpose is to make the UAV reach any target point from a certain starting point, and the flying height and speed are variable during navigation. In this work, we propose a deep reinforcement learning (DRL)-based method combined with human-in-the-loop, which allows the UAV to avoid obstacles automatically during flying. We design multiple reward functions based on the relevant domain knowledge to guide UAV navigation. The role of human-in-the-loop is to dynamically change the reward function of the UAV in different situations to suit the obstacle avoidance of the UAV better. We verify the success rate and average step size on urban, rural, and forest scenarios, and the experimental results show that the proposed method can reduce the training convergence time and improve the efficiency and accuracy of navigation tasks. The code is available on the website https://github.com/Monnalo/UAV_navigation.

📄 PDF Abstract BibTeX arXiv:2304.05959

Code (1)

monnalo/uav_navigation 공식 구현 pytorch

Tasks

continuous-controlContinuous ControlDeep Reinforcement Learningreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs

2024-11-27 · Haochen Chai, Meimei Su, Yang Lyu, ZhunGa Liu 외

Fixed-wing Unmanned Aerial Vehicles (UAVs) are one of the most commonly used platforms for the burgeoning Low-altitude Economy (LAE) and Urban Air Mobility (UAM), due to their long endurance and high-speed capabilities. …

Collision AvoidanceDeep Reinforcement LearningEdge-computing

Learning Vision-based Reactive Policies for Obstacle Avoidance

2020-10-30 · Elie Aljalbout, Ji Chen, Konstantin Ritt, Maximilian Ulmer 외

In this paper, we address the problem of vision-based obstacle avoidance for robotic manipulators. This topic poses challenges for both perception and motion generation. While most work in the field aims at improving one…

Motion Generation

Deep Reinforcement Learning Controller for 3D Path-following and Collision Avoidance by Autonomous Underwater Vehicles

2020-06-17 · Simen Theie Havenstrøm, Adil Rasheed, Omer San

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical…

Collision AvoidanceDecision MakingDeep Reinforcement LearningReinforcement Learning (RL)

SERA: Safe and Efficient Reactive Obstacle Avoidance for Collaborative Robotic Planning in Unstructured Environments

2022-03-24 · Apan Dastider, Mingjie Lin

Safe and efficient collaboration among multiple robots in unstructured environments is increasingly critical in the era of Industry 4.0. However, achieving robust and autonomous collaboration among humans and other robot…

Deep Reinforcement Learning-based Obstacle Avoidance for Robot Movement in Warehouse Environments

2024-09-23 · Keqin Li, Jiajing Chen, Denzhi Yu, Tao Dajun 외

At present, in most warehouse environments, the accumulation of goods is complex, and the management personnel in the control of goods at the same time with the warehouse mobile robot trajectory interaction, the traditio…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning