Federated Reinforcement Learning for Collective Navigation of Robotic Swarms

2022-02-02 · Seongin Na, Tomáš Rouček, Jiří Ulrich, Jan Pikman, Tomáš Krajník, Barry Lennox, Farshad Arvin

The recent advancement of Deep Reinforcement Learning (DRL) contributed to robotics by allowing automatic controller design. The automatic controller design is a crucial approach for designing swarm robotic systems, which require more complex controllers than a single robot system to lead a desired collective behaviour. Although the DRL-based controller design method showed its effectiveness, the reliance on the central training server is a critical problem in real-world environments where robot-server communication is unstable or limited. We propose a novel Federated Learning (FL) based DRL training strategy (FLDDPG) for use in swarm robotic applications. Through the comparison with baseline strategies under a limited communication bandwidth scenario, it is shown that the FLDDPG method resulted in higher robustness and generalisation ability into a different environment and real robots, while the baseline strategies suffer from the limitation of communication bandwidth. This result suggests that the proposed method can benefit swarm robotic systems operating in environments with limited communication bandwidth, e.g., in high-radiation, underwater, or subterranean environments.

📄 PDF Abstract BibTeX arXiv:2202.01141

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningFederated Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning for Active Matter

2025-03-30 · Wenjie Cai, Gongyi Wang, Yu Zhang, Xiang Qu 외

Active matter refers to systems composed of self-propelled entities that consume energy to produce motion, exhibiting complex non-equilibrium dynamics that challenge traditional models. With the rapid advancements in mac…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Efficient collective swimming by harnessing vortices through deep reinforcement learning

2018-02-07 · Siddhartha Verma, Guido Novati, Petros Koumoutsakos

Fish in schooling formations navigate complex flow-fields replete with mechanical energy in the vortex wakes of their companions. Their schooling behaviour has been associated with evolutionary advantages including colle…

Deep Reinforcement Learning Navigate reinforcement-learning Reinforcement Learning+1

A Unified Stochastic Mechanism Underlying Collective Behavior in Ants, Physical Systems, and Robotic Swarms

2025-11-08 · Lianhao Yin, Haiping Yu, Pascal Spino, Daniela Rus arxiv

Biological swarms, such as ant colonies, achieve collective goals through decentralized and stochastic individual behaviors. Similarly, physical systems composed of gases, liquids, and solids exhibit random particle moti…

Communication-Free Collective Navigation for a Swarm of UAVs via LiDAR-Based Deep Reinforcement Learning

2026-01-20 · Myong-Yol Choi, Hankyoul Ko, Hanse Cho, Changseung Kim 외 arxiv

This paper presents a deep reinforcement learning (DRL) based controller for collective navigation of unmanned aerial vehicle (UAV) swarms in communication-denied environments, enabling robust operation in complex, obsta…

Reinforcement Learning

Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems

2019-01-19 · Boyi Liu, Lujia Wang, Ming Liu

This paper was motivated by the problem of how to make robots fuse and transfer their experience so that they can effectively use prior knowledge and quickly adapt to new environments. To address the problem, we present …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Robot Navigation+1