paper-with-me

Papers

Interpretable Learned Emergent Communication for Human-Agent Teams

2022-01-19 · Seth Karten, Mycal Tucker, Huao Li, Siva Kailas, Michael Lewis, Katia Sycara

Learning interpretable communication is essential for multi-agent and human-agent teams (HATs). In multi-agent reinforcement learning for partially-observable environments, agents may convey information to others via learned communication, allowing the team to complete its task. Inspired by human languages, recent works study discrete (using only a finite set of tokens) and sparse (communicating only at some time-steps) communication. However, the utility of such communication in human-agent team experiments has not yet been investigated. In this work, we analyze the efficacy of sparse-discrete methods for producing emergent communication that enables high agent-only and human-agent team performance. We develop agent-only teams that communicate sparsely via our scheme of Enforcers that sufficiently constrain communication to any budget. Our results show no loss or minimal loss of performance in benchmark environments and tasks. In human-agent teams tested in benchmark environments, where agents have been modeled using the Enforcers, we find that a prototype-based method produces meaningful discrete tokens that enable human partners to learn agent communication faster and better than a one-hot baseline. Additional HAT experiments show that an appropriate sparsity level lowers the cognitive load of humans when communicating with teams of agents and leads to superior team performance.

📄 PDF Abstract BibTeX arXiv:2201.07452

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Similar Papers 제목 키워드 기반

Emergent Communication with Attention

2023-05-18 · Ryokan Ri, Ryo Ueda, Jason Naradowsky

To develop computational agents that better communicate using their own emergent language, we endow the agents with an ability to focus their attention on particular concepts in the environment. Humans often understand a…

Learning to Draw: Emergent Communication through Sketching

2021-06-03 · NeurIPS 2021 12 · Daniela Mihai, Jonathon Hare

Evidence that visual communication preceded written language and provided a basis for it goes back to prehistory, in forms such as cave and rock paintings depicting traces of our distant ancestors. Emergent communication…

Prehistory

Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents

2021-10-12 · ICCV 2021 10 · Shivansh Patel, Saim Wani, Unnat Jain, Alexander Schwing 외

Communication between embodied AI agents has received increasing attention in recent years. Despite its use, it is still unclear whether the learned communication is interpretable and grounded in perception. To study the…

Learning to cooperate: Emergent communication in multi-agent navigation

2020-04-02 · Ivana Kajić, Eser Aygün, Doina Precup

Emergent communication in artificial agents has been studied to understand language evolution, as well as to develop artificial systems that learn to communicate with humans. We show that agents performing a cooperative …

Speaking Your Language: Spatial Relationships in Interpretable Emergent Communication

2024-06-11 · Olaf Lipinski, Adam J. Sobey, Federico Cerutti, Timothy J. Norman

Effective communication requires the ability to refer to specific parts of an observation in relation to others. While emergent communication literature shows success in developing various language properties, no researc…