paper-with-me

Papers

Application of Deep Reinforcement Learning to UAV Swarming for Ground Surveillance

2025-01-15 · Raúl Arranz, David Carramiñana, Gonzalo de Miguel, Juan A. Besada, Ana M. Bernardos

This paper summarizes in depth the state of the art of aerial swarms, covering both classical and new reinforcement-learning-based approaches for their management. Then, it proposes a hybrid AI system, integrating deep reinforcement learning in a multi-agent centralized swarm architecture. The proposed system is tailored to perform surveillance of a specific area, searching and tracking ground targets, for security and law enforcement applications. The swarm is governed by a central swarm controller responsible for distributing different search and tracking tasks among the cooperating UAVs. Each UAV agent is then controlled by a collection of cooperative sub-agents, whose behaviors have been trained using different deep reinforcement learning models, tailored for the different task types proposed by the swarm controller. More specifically, proximal policy optimization (PPO) algorithms were used to train the agents' behavior. In addition, several metrics to assess the performance of the swarm in this application were defined. The results obtained through simulation show that our system searches the operation area effectively, acquires the targets in a reasonable time, and is capable of tracking them continuously and consistently.

📄 PDF Abstract BibTeX arXiv:2501.08655

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learningReinforcement Learning

Similar Papers 제목 키워드 기반

Deep Learning-based Detection of Bacterial Swarm Motion Using a Single Image

2024-10-19 · Yuzhu Li, Hao Li, WeiJie Chen, Keelan O'Riordan 외

Distinguishing between swarming and swimming, the two principal forms of bacterial movement, holds significant conceptual and clinical relevance. This is because bacteria that exhibit swarming capabilities often possess …

DiagnosticSensitivitySpecificity

Predator-prey survival pressure is sufficient to evolve swarming behaviors

2023-08-24 · Jianan Li, Liang Li, Shiyu Zhao

The comprehension of how local interactions arise in global collective behavior is of utmost importance in both biological and physical research. Traditional agent-based models often rely on static rules that fail to cap…

Diversityreinforcement-learningReinforcement Learning

Swarming for Faster Convergence in Stochastic Optimization

2018-06-11 · Shi Pu, Alfredo Garcia

We study a distributed framework for stochastic optimization which is inspired by models of collective motion found in nature (e.g., swarming) with mild communication requirements. Specifically, we analyze a scheme in wh…

Stochastic Optimization

Predator confusion is sufficient to evolve swarming behavior

2012-09-14 · Randal S. Olson, Arend Hintze, Fred C. Dyer, David B. Knoester 외

Swarming behaviors in animals have been extensively studied due to their implications for the evolution of cooperation, social cognition, and predator-prey dynamics. An important goal of these studies is discerning which…

PySwarming: a research toolkit for Swarm Robotics

2023-09-26 · Journal of Open Source Software 2023 9 · Emerson Martins de Andrade, Antonio Carlos Fernandes, Joel Sena Sales Junior

When considering a system composed of a group of robots, swarm robotics is an approach that can be used to coordinate this group. These swarms can be inspired or not by social insects or other animal societies (Trianni, …