Learning to Communicate Through Implicit Communication Channels
Effective communication is an essential component in collaborative multi-agent systems. Situations where explicit messaging is not feasible have been common in human society throughout history, which motivate the study of implicit communication. Previous works on learning implicit communication mostly rely on theory of mind (ToM), where agents infer the mental states and intentions of others by interpreting their actions. However, ToM-based methods become less effective in making accurate inferences in complex tasks. In this work, we propose the Implicit Channel Protocol (ICP) framework, which allows agents to communicate through implicit communication channels similar to the explicit ones. ICP leverages a subset of actions, denoted as the scouting actions, and a mapping between information and these scouting actions that encodes and decodes the messages. We propose training algorithms for agents to message and act, including learning with a randomly initialized information map and with a delayed information map. The efficacy of ICP has been tested on the tasks of Guessing Numbers, Revealing Goals, and Hanabi, where ICP significantly outperforms baseline methods through more efficient information transmission.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The Silence that Speaks: Neural Estimation via Communication Gaps
Accurate remote state estimation is a fundamental component of many autonomous and networked dynamical systems, where multiple decision-making agents interact and communicate over shared, bandwidth-constrained channels. …
Online Optimization for Learning to Communicate over Time-Correlated Channels
Machine learning techniques have garnered great interest in designing communication systems owing to their capacity in tackling with channel uncertainty. To provide theoretical guarantees for learning-based communication…
Generalization BoundsOn stochastic string stability with applications to platooning over additive noise channels
This paper addresses the string stabilization of vehicular platooning when stochastic phenomena are inherent in inter-vehicle communication. To achieve this, we first provide two definitions to analytically assess the st…
Cheap Talk Discovery and Utilization in Multi-Agent Reinforcement Learning
By enabling agents to communicate, recent cooperative multi-agent reinforcement learning (MARL) methods have demonstrated better task performance and more coordinated behavior. Most existing approaches facilitate inter-a…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Toward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Language
Communication between agents in collaborative multi-agent settings is in general implicit or a direct data stream. This paper considers text-based natural language as a novel form of communication between multiple agents…
Navigatereinforcement-learningReinforcement LearningReinforcement Learning (RL)