paper-with-me

홈 › Papers

Semantics and Spatiality of Emergent Communication

2024-11-15 · Rotem Ben Zion, Boaz Carmeli, Orr Paradise, Yonatan Belinkov

When artificial agents are jointly trained to perform collaborative tasks using a communication channel, they develop opaque goal-oriented communication protocols. Good task performance is often considered sufficient evidence that meaningful communication is taking place, but existing empirical results show that communication strategies induced by common objectives can be counterintuitive whilst solving the task nearly perfectly. In this work, we identify a goal-agnostic prerequisite to meaningful communication, which we term semantic consistency, based on the idea that messages should have similar meanings across instances. We provide a formal definition for this idea, and use it to compare the two most common objectives in the field of emergent communication: discrimination and reconstruction. We prove, under mild assumptions, that semantically inconsistent communication protocols can be optimal solutions to the discrimination task, but not to reconstruction. We further show that the reconstruction objective encourages a stricter property, spatial meaningfulness, which also accounts for the distance between messages. Experiments with emergent communication games validate our theoretical results. These findings demonstrate an inherent advantage of distance-based communication goals, and contextualize previous empirical discoveries.

📄 PDF Abstract BibTeX arXiv:2411.10173

Code (1)

Rotem-BZ/SemanticConsistency 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Avoiding hashing and encouraging visual semantics in referential emergent language games

2019-11-13 · Daniela Mihai, Jonathon Hare

There has been an increasing interest in the area of emergent communication between agents which learn to play referential signalling games with realistic images. In this work, we consider the signalling game setting of …

The emergence of visual semantics through communication games

2021-01-25 · Daniela Mihai, Jonathon Hare

The emergence of communication systems between agents which learn to play referential signalling games with realistic images has attracted a lot of attention recently. The majority of work has focused on using fixed, pre…

Generalizing Emergent Communication

2020-01-06 · Thomas A. Unger, Elia Bruni

We converted the recently developed BabyAI grid world platform to a sender/receiver setup in order to test the hypothesis that established deep reinforcement learning techniques are sufficient to incentivize the emergenc…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

EC^2: Emergent Communication for Embodied Control

2023-04-19 · Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo 외

Embodied control requires agents to leverage multi-modal pre-training to quickly learn how to act in new environments, where video demonstrations contain visual and motion details needed for low-level perception and cont…

Contrastive LearningLanguage Modelling

EC2: Emergent Communication for Embodied Control

2023-01-01 · CVPR 2023 1 · Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo 외

Embodied control requires agents to leverage multi-modal pre-training to quickly learn how to act in new environments, where video demonstrations contain visual and motion details needed for low-level perception and …

Contrastive LearningLanguage Modelling