paper-with-me

홈 › Papers

Exploring Zero-Shot Emergent Communication in Embodied Multi-Agent Populations

2020-10-29 · Kalesha Bullard, Franziska Meier, Douwe Kiela, Joelle Pineau, Jakob Foerster

Effective communication is an important skill for enabling information exchange and cooperation in multi-agent settings. Indeed, emergent communication is now a vibrant field of research, with common settings involving discrete cheap-talk channels. One limitation of this setting is that it does not allow for the emergent protocols to generalize beyond the training partners. Furthermore, so far emergent communication has primarily focused on the use of symbolic channels. In this work, we extend this line of work to a new modality, by studying agents that learn to communicate via actuating their joints in a 3D environment. We show that under realistic assumptions, a non-uniform distribution of intents and a common-knowledge energy cost, these agents can find protocols that generalize to novel partners. We also explore and analyze specific difficulties associated with finding these solutions in practice. Finally, we propose and evaluate initial training improvements to address these challenges, involving both specific training curricula and providing the latent feature that can be coordinated on during training.

📄 PDF Abstract BibTeX arXiv:2010.15896

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

EC^2: Emergent Communication for Embodied Control

2023-04-19 · Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo 외

Embodied control requires agents to leverage multi-modal pre-training to quickly learn how to act in new environments, where video demonstrations contain visual and motion details needed for low-level perception and cont…

Contrastive LearningLanguage Modelling

EC2: Emergent Communication for Embodied Control

2023-01-01 · CVPR 2023 1 · Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo 외

Embodied control requires agents to leverage multi-modal pre-training to quickly learn how to act in new environments, where video demonstrations contain visual and motion details needed for low-level perception and …

Contrastive LearningLanguage Modelling

Learning Translations: Emergent Communication Pretraining for Cooperative Language Acquisition

2024-02-26 · Dylan Cope, Peter McBurney

In Emergent Communication (EC) agents learn to communicate with one another, but the protocols that they develop are specialised to their training community. This observation led to research into Zero-Shot Coordination (…

Imitation LearningLanguage Acquisition

Drawing with Strangers: Population Scaling Drives Zero-Shot Mutual Intelligibility in Emergent Sketching

2026-06-09 · Jooyeon Kim arxiv

Generalization in emergent communication has largely focused on novel inputs or linguistic structures, yet the capacity for agents to communicate with strangers from strictly disjoint communities remains relatively unexp…

MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigation

2024-01-14 · Jiaqi Chen, Bingqian Lin, ran Xu, Zhenhua Chai 외

Embodied agents equipped with GPT as their brains have exhibited extraordinary decision-making and generalization abilities across various tasks. However, existing zero-shot agents for vision-and-language navigation (VLN…

Decision MakingVision and Language Navigation