ClusterComm: Discrete Communication in Decentralized MARL using Internal Representation Clustering

2024-01-07 · Robert Müller, Hasan Turalic, Thomy Phan, Michael Kölle, Jonas Nüßlein, Claudia Linnhoff-Popien

In the realm of Multi-Agent Reinforcement Learning (MARL), prevailing approaches exhibit shortcomings in aligning with human learning, robustness, and scalability. Addressing this, we introduce ClusterComm, a fully decentralized MARL framework where agents communicate discretely without a central control unit. ClusterComm utilizes Mini-Batch-K-Means clustering on the last hidden layer's activations of an agent's policy network, translating them into discrete messages. This approach outperforms no communication and competes favorably with unbounded, continuous communication and hence poses a simple yet effective strategy for enhancing collaborative task-solving in MARL.

📄 PDF Abstract BibTeX arXiv:2401.03504

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringMulti-agent Reinforcement Learning reinforcement-learning

Reward-Independent Messaging for Decentralized Multi-Agent Reinforcement Learning

2025-05-28 · Naoto Yoshida, Tadahiro Taniguchi

In multi-agent reinforcement learning (MARL), effective communication improves agent performance, particularly under partial observability. We propose MARL-CPC, a framework that enables communication among fully decentra…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Taming Communication and Sample Complexities in Decentralized Policy Evaluation for Cooperative Multi-Agent Reinforcement Learning

2021-12-01 · NeurIPS 2021 12 · Xin Zhang, Zhuqing Liu, Jia Liu, Zhengyuan Zhu 외

Cooperative multi-agent reinforcement learning (MARL) has received increasing attention in recent years and has found many scientific and engineering applications. However, a key challenge arising from many cooperative M…

Multi-agent Reinforcement Learning Reinforcement Learning (RL)Stochastic Optimization

Finite-Sample Analysis For Decentralized Batch Multi-Agent Reinforcement Learning With Networked Agents

2018-12-06 · Kaiqing Zhang, Zhuoran Yang, Han Liu, Tong Zhang 외

Despite the increasing interest in multi-agent reinforcement learning (MARL) in multiple communities, understanding its theoretical foundation has long been recognized as a challenging problem. In this work, we address t…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control

2023-10-03 · Rohit Bokade, Xiaoning Jin, Christopher Amato

Traffic signal control (TSC) is a challenging problem within intelligent transportation systems and has been tackled using multi-agent reinforcement learning (MARL). While centralized approaches are often infeasible for …

Multi-agent Reinforcement Learning Traffic Signal Control

Sample and Communication Efficient Fully Decentralized MARL Policy Evaluation via a New Approach: Local TD update

2024-03-23 · FNU Hairi, Zifan Zhang, Jia Liu

In actor-critic framework for fully decentralized multi-agent reinforcement learning (MARL), one of the key components is the MARL policy evaluation (PE) problem, where a set of $N$ agents work cooperatively to evaluate …

Multi-agent Reinforcement Learning