A Scalable Decentralized Reinforcement Learning Framework for UAV Target Localization Using Recurrent PPO

2024-12-09 · Leon Fernando, Billy Pik Lik Lau, Chau Yuen, U-Xuan Tan

The rapid advancements in unmanned aerial vehicles (UAVs) have unlocked numerous applications, including environmental monitoring, disaster response, and agricultural surveying. Enhancing the collective behavior of multiple decentralized UAVs can significantly improve these applications through more efficient and coordinated operations. In this study, we explore a Recurrent PPO model for target localization in perceptually degraded environments like places without GNSS/GPS signals. We first developed a single-drone approach for target identification, followed by a decentralized two-drone model. Our approach can utilize two types of sensors on the UAVs, a detection sensor and a target signal sensor. The single-drone model achieved an accuracy of 93%, while the two-drone model achieved an accuracy of 86%, with the latter requiring fewer average steps to locate the target. This demonstrates the potential of our method in UAV swarms, offering efficient and effective localization of radiant targets in complex environmental conditions.

📄 PDF Abstract BibTeX arXiv:2412.06231

Code (0)

등록된 구현이 없습니다.

Tasks

Disaster Response

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Decentralized Gaussian Filters for Cooperative Self-localization and Multi-target Tracking

2020-04-15

Scalable and decentralized algorithms for Cooperative Self-localization (CS) of agents, and Multi-Target Tracking (MTT) are important in many applications. In this work, we address the problem of Simultaneous Cooperative…

Scalable Reinforcement Learning Policies for Multi-Agent Control

2020-11-16 · Christopher D. Hsu, Heejin Jeong, George J. Pappas, Pratik Chaudhari

We develop a Multi-Agent Reinforcement Learning (MARL) method to learn scalable control policies for target tracking. Our method can handle an arbitrary number of pursuers and targets; we show results for tasks consistin…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Scalable Network-Aware Multi-Agent Reinforcement Learning Framework for Decentralized Inverter-based Voltage Control

2023-12-07 · Han Xu, Jialin Zheng, Guannan Qu

This paper addresses the challenges associated with decentralized voltage control in power grids due to an increase in distributed generations (DGs). Traditional model-based voltage control methods struggle with the rapi…

Multi-agent Reinforcement Learning

Decentralized Multi-Robot Obstacle Detection and Tracking in a Maritime Scenario

2026-02-12 · Muhammad Farhan Ahmed, Vincent Frémont arxiv

Autonomous aerial-surface robot teams offer a scalable solution for maritime monitoring, but deployment remains difficult due to water-induced visual artifacts and bandwidth-limited coordination. This paper presents a de…

Learning a Decentralized Multi-arm Motion Planner

2020-11-05 · Huy Ha, Jingxi Xu, Shuran Song

We present a closed-loop multi-arm motion planner that is scalable and flexible with team size. Traditional multi-arm robot systems have relied on centralized motion planners, whose runtimes often scale exponentially wit…

Motion Planning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1