Fully Independent Communication in Multi-Agent Reinforcement Learning

2024-01-26 · Rafael Pina, Varuna De Silva, Corentin Artaud, Xiaolan Liu

Multi-Agent Reinforcement Learning (MARL) comprises a broad area of research within the field of multi-agent systems. Several recent works have focused specifically on the study of communication approaches in MARL. While multiple communication methods have been proposed, these might still be too complex and not easily transferable to more practical contexts. One of the reasons for that is due to the use of the famous parameter sharing trick. In this paper, we investigate how independent learners in MARL that do not share parameters can communicate. We demonstrate that this setting might incur into some problems, to which we propose a new learning scheme as a solution. Our results show that, despite the challenges, independent agents can still learn communication strategies following our method. Additionally, we use this method to investigate how communication in MARL is affected by different network capacities, both for sharing and not sharing parameters. We observe that communication may not always be needed and that the chosen agent network sizes need to be considered when used together with communication in order to achieve efficient learning.

📄 PDF Abstract BibTeX arXiv:2401.15059

Code (1)

rafaelmp2/marl-indep-comm 공식 구현 pytorch

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Reward-Independent Messaging for Decentralized Multi-Agent Reinforcement Learning

2025-05-28 · Naoto Yoshida, Tadahiro Taniguchi

In multi-agent reinforcement learning (MARL), effective communication improves agent performance, particularly under partial observability. We propose MARL-CPC, a framework that enables communication among fully decentra…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Distributed Transmission Control for Wireless Networks using Multi-Agent Reinforcement Learning

2022-05-13 · Collin Farquhar, Prem Sagar Pattanshetty Vasanth Kumar, Anu Jagannath, Jithin Jagannath

We examine the problem of transmission control, i.e., when to transmit, in distributed wireless communications networks through the lens of multi-agent reinforcement learning. Most other works using reinforcement learnin…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MACTAS: Self-Attention-Based Inter-Agent Communication in Multi-Agent Reinforcement Learning with Action-Value Function Decomposition

2025-08-19 · Maciej Wojtala, Bogusz Stefańczyk, Dominik Bogucki, Łukasz Lepak 외 arxiv

Communication is essential for the collective execution of complex tasks by human agents, motivating interest in communication mechanisms for multi-agent reinforcement learning (MARL). However, existing communication pro…

Multi-agent Reinforcement Learning

Stigmergic Independent Reinforcement Learning for Multi-Agent Collaboration

2019-11-28 · Xing Xu, Rongpeng Li, Zhifeng Zhao, Honggang Zhang

With the rapid evolution of wireless mobile devices, there emerges an increased need to design effective collaboration mechanisms between intelligent agents, so as to gradually approach the final collective objective thr…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Control

2019-03-11 · Tianshu Chu, Jie Wang, Lara Codecà, Zhaojian Li

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centrali…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+2