TarMAC: Targeted Multi-Agent Communication
We propose a targeted communication architecture for multi-agent reinforcement learning, where agents learn both what messages to send and whom to address them to while performing cooperative tasks in partially-observable environments. This targeting behavior is learnt solely from downstream task-specific reward without any communication supervision. We additionally augment this with a multi-round communication approach where agents coordinate via multiple rounds of communication before taking actions in the environment. We evaluate our approach on a diverse set of cooperative multi-agent tasks, of varying difficulties, with varying number of agents, in a variety of environments ranging from 2D grid layouts of shapes and simulated traffic junctions to 3D indoor environments, and demonstrate the benefits of targeted and multi-round communication. Moreover, we show that the targeted communication strategies learned by agents are interpretable and intuitive. Finally, we show that our architecture can be easily extended to mixed and competitive environments, leading to improved performance and sample complexity over recent state-of-the-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-agent Reinforcement LearningReinforcement LearningSimilar Papers 제목 키워드 기반
Wireless Communication Enhanced Value Decomposition for Multi-Agent Reinforcement Learning
Cooperation in multi-agent reinforcement learning (MARL) benefits from inter-agent communication, yet most approaches assume idealized channels and existing value decomposition methods ignore who successfully shared info…
Multi-agent Reinforcement LearningTARMAC: A Taxonomy for Robot Manipulation in Chemistry
Chemistry laboratory automation aims to increase throughput, reproducibility, and safety, yet many existing systems still depend on frequent human intervention. Advances in robotics have reduced this dependency, but with…
Robot ManipulationT2MAC: Targeted and Trusted Multi-Agent Communication through Selective Engagement and Evidence-Driven Integration
Communication stands as a potent mechanism to harmonize the behaviors of multiple agents. However, existing works primarily concentrate on broadcast communication, which not only lacks practicality, but also leads to inf…
SMACSMAC+Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanism
Communication can impressively improve cooperation in multi-agent reinforcement learning (MARL), especially for partially-observed tasks. However, existing works either broadcast the messages leading to information redun…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Multi-Agent Reinforcement Learning for Fast-Timescale Demand Response of Residential Loads
To integrate high amounts of renewable energy resources, electrical power grids must be able to cope with high amplitude, fast timescale variations in power generation. Frequency regulation through demand response has th…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)