Modular Reinforcement Learning For Cooperative Swarms

2026-05-06 · Erel Shtossel, Gal A. Kaminka arxiv

A cooperative robot swarm is a collective of computationally-limited robots that share a common goal. Each robot can only interact with a small subset of its peers, without knowing how this affects the collective utility. Recent advances in distributed multi-agent reinforcement learning have demonstrated that it is possible for robots to learn how to interact effectively with others, in a manner that is aligned with the common goal, despite each robot learning independently of others. However, this requires each robot to represent a potentially combinatorial number of interaction states, challenging the memory capabilities of the robots. This paper proposes an alternative approach for representing spatial interaction states for multi-robot reinforcement learning in swarms. A modular (decomposed) representation is used, where each feature of the state is handled by a separate learning procedure, and the results aggregated. We demonstrate the efficacy of the approach in numerous experiments with simulated robot swarms carrying out foraging.

📄 PDF Abstract BibTeX arXiv:2605.04939

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Show me what you want: Inverse reinforcement learning to automatically design robot swarms by demonstration

2023-01-17 · Ilyes Gharbi, Jonas Kuckling, David Garzón Ramos, Mauro Birattari

Automatic design is a promising approach to generating control software for robot swarms. So far, automatic design has relied on mission-specific objective functions to specify the desired collective behavior. In this pa…

reinforcement-learning Reinforcement Learning (RL)

Cooperative Cognitive Dynamic System in UAV Swarms: Reconfigurable Mechanism and Framework

2024-05-18 · Ziye Jia, Jiahao You, Chao Dong, Qihui Wu 외

As the demands for immediate and effective responses increase in both civilian and military domains, the unmanned aerial vehicle (UAV) swarms emerge as effective solutions, in which multiple cooperative UAVs can work tog…

Management

A Learning Framework For Cooperative Collision Avoidance of UAV Swarms Leveraging Domain Knowledge

2025-07-15 · Shuangyao Huang, Haibo Zhang, Zhiyi Huang

This paper presents a multi-agent reinforcement learning (MARL) framework for cooperative collision avoidance of UAV swarms leveraging domain knowledge-driven reward. The reward is derived from knowledge in the domain of…

Collision Avoidance Multi-agent Reinforcement Learning

Rethinking the Implementation Matters in Cooperative Multi-Agent Reinforcement Learning

2021-02-06 · Jian Hu, Siyang Jiang, Seth Austin Harding, Haibin Wu 외

Multi-Agent Reinforcement Learning (MARL) has seen revolutionary breakthroughs with its successful application to multi-agent cooperative tasks such as computer games and robot swarms. QMIX, a widely popular MARL algorit…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+4

UAV-assisted Online Machine Learning over Multi-Tiered Networks: A Hierarchical Nested Personalized Federated Learning Approach

2021-06-29 · Su Wang, Seyyedali Hosseinalipour, Maria Gorlatova, Christopher G. Brinton 외

We investigate training machine learning (ML) models across a set of geo-distributed, resource-constrained clusters of devices through unmanned aerial vehicles (UAV) swarms. The presence of time-varying data heterogeneit…

Decision Making Deep Reinforcement Learning Federated Learning Personalized Federated Learning+1