Local Communication Protocols for Learning Complex Swarm Behaviors with Deep Reinforcement Learning

2017-09-21 · Maximilian Hüttenrauch, Adrian Šošić, Gerhard Neumann

Swarm systems constitute a challenging problem for reinforcement learning (RL) as the algorithm needs to learn decentralized control policies that can cope with limited local sensing and communication abilities of the agents. While it is often difficult to directly define the behavior of the agents, simple communication protocols can be defined more easily using prior knowledge about the given task. In this paper, we propose a number of simple communication protocols that can be exploited by deep reinforcement learning to find decentralized control policies in a multi-robot swarm environment. The protocols are based on histograms that encode the local neighborhood relations of the agents and can also transmit task-specific information, such as the shortest distance and direction to a desired target. In our framework, we use an adaptation of Trust Region Policy Optimization to learn complex collaborative tasks, such as formation building and building a communication link. We evaluate our findings in a simulated 2D-physics environment, and compare the implications of different communication protocols.

📄 PDF Abstract BibTeX arXiv:1709.07224

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Communication-Free Collective Navigation for a Swarm of UAVs via LiDAR-Based Deep Reinforcement Learning

2026-01-20 · Myong-Yol Choi, Hankyoul Ko, Hanse Cho, Changseung Kim 외 arxiv

This paper presents a deep reinforcement learning (DRL) based controller for collective navigation of unmanned aerial vehicle (UAV) swarms in communication-denied environments, enabling robust operation in complex, obsta…

Reinforcement Learning

Physics-Informed Modeling and Control of Emergent Behaviors in Robot Swarms

2026-06-01 · Zixuan Jin, Wenzhuo Zhang, Shuxian Quan, Zirui Dong 외 arxiv

Robot swarms can exhibit coherent collective behaviors through local perception, limited communication and decentralized decision-making, yet modeling and controlling such emergence remains challenging when behaviors unf…

Reinforcement Learning

Deep Reinforcement Learning for Swarm Systems

2018-07-17 · Maximilian Hüttenrauch, Adrian Šošić, Gerhard Neumann

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required f…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Localization and Clustering Based on Swarm Intelligence in UAV Networks for Emergency Communications

2019-07-28 · IEEE Internet of Things Journal 2019 7 · Muhammad Yeasir Arafat, Sangman Moh, Member, IEEE

Abstract— In recent years, unmanned aerial vehicle (UAV) networks have been a focus area of the academic and industrial research community. They have been used in many military and civilian applications. Emergency …

Clustering

Exponential Separations in Local Differential Privacy

2019-07-01 · Matthew Joseph, Jieming Mao, Aaron Roth

We prove a general connection between the communication complexity of two-player games and the sample complexity of their multi-player locally private analogues. We use this connection to prove sample complexity lower bo…