Learning Multi-Agent Coordination through Connectivity-driven Communication

2020-02-12 · Emanuele Pesce, Giovanni Montana

In artificial multi-agent systems, the ability to learn collaborative policies is predicated upon the agents' communication skills: they must be able to encode the information received from the environment and learn how to share it with other agents as required by the task at hand. We present a deep reinforcement learning approach, Connectivity Driven Communication (CDC), that facilitates the emergence of multi-agent collaborative behaviour only through experience. The agents are modelled as nodes of a weighted graph whose state-dependent edges encode pair-wise messages that can be exchanged. We introduce a graph-dependent attention mechanisms that controls how the agents' incoming messages are weighted. This mechanism takes into full account the current state of the system as represented by the graph, and builds upon a diffusion process that captures how the information flows on the graph. The graph topology is not assumed to be known a priori, but depends dynamically on the agents' observations, and is learnt concurrently with the attention mechanism and policy in an end-to-end fashion. Our empirical results show that CDC is able to learn effective collaborative policies and can over-perform competing learning algorithms on cooperative navigation tasks.

📄 PDF Abstract BibTeX arXiv:2002.05233

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningMulti-agent Reinforcement Learning Reinforcement Learning

Connectivity-Preserving Multi-Agent Area Coverage via Optimal-Transport-Based Density-Driven Optimal Control (D2OC)

2025-11-23 · Kooktae Lee, Ethan Brook arxiv

Multi-agent systems play a central role in area coverage tasks across search-and-rescue, environmental monitoring, and precision agriculture. Achieving non-uniform coverage, where spatial priorities vary across the domai…

Cooperative Multi-Agent Assignment over Stochastic Graphs via Constrained Reinforcement Learning

2025-02-27 · Leopoldo Agorio, Sean Van Alen, Santiago Paternain, Miguel Calvo-Fullana 외

Constrained multi-agent reinforcement learning offers the framework to design scalable and almost surely feasible solutions for teams of agents operating in dynamic environments to carry out conflicting tasks. We address…

Multi-agent Reinforcement Learning

Rationality and connectivity in stochastic learning for networked coordination games

2023-09-29 · Yifei Zhang, Marcos M. Vasconcelos

Coordination is a desirable feature in many multi-agent systems such as robotic and socioeconomic networks. We consider a task allocation problem as a binary networked coordination game over an undirected regular graph. …

Equitable Coordination in Multi-agent Power Systems: Impacts of Computation Granularity

2023-11-20 · Yuhan Du, Javad Mohammadi

The growing integration of distributed energy resources drives the centralized power system towards a decentralized multi-agent network. Operating multi-agent networks significantly relies on inter-agent communications. …

Dynamic Queue-Jump Lane for Emergency Vehicles under Partially Connected Settings: A Multi-Agent Deep Reinforcement Learning Approach

2020-03-02 · Haoran Su, Kejian Shi, Joseph. Y. J. Chow, Li Jin

Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. The main reason behind EMV service delay is the lack of communication and cooperation between ve…

Blocking Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning+2