Developmentally motivated emergence of compositional communication via template transfer
This paper explores a novel approach to achieving emergent compositional communication in multi-agent systems. We propose a training regime implementing template transfer, the idea of carrying over learned biases across contexts. In our method, a sender-receiver pair is first trained with disentangled loss functions and then the receiver is transferred to train a new sender with a standard loss. Unlike other methods (e.g. the obverter algorithm), our approach does not require imposing inductive biases on the architecture of the agents. We experimentally show the emergence of compositional communication using topographical similarity, zero-shot generalization and context independence as evaluation metrics. The presented approach is connected to an important line of work in semiotics and developmental psycholinguistics: it supports a conjecture that compositional communication is scaffolded on simpler communication protocols.
Code (1)
Tasks
Zero-shot GeneralizationSimilar Papers 제목 키워드 기반
Measuring non-trivial compositionality in emergent communication
Compositionality is an important explanatory target in emergent communication and language evolution. The vast majority of computational models of communication account for the emergence of only a very basic form of comp…
Intrinsically Motivated Compositional Language Emergence
Recently, there has been a great deal of research in emergent communication on artificial agents interacting in simulated environments. Recent studies have revealed that, in general, emergent languages do not follow the …
Language AcquisitionEmergence of compositional language in communication through noisy channel
In this paper, we investigate how communication through a noisy channel can lead to the emergence of compositional language. Our approach is $\mbox{end-to-end}$, allows for different inductive biases on the agents’ archi…
Emergence of Grounded Compositional Language in Multi-Agent Populations
By capturing statistical patterns in large corpora, machine learning has enabled significant advances in natural language processing, including in machine translation, question answering, and sentiment analysis. However,…
Machine TranslationQuestion AnsweringSentiment AnalysisTranslationCatalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication
Communication is compositional if complex signals can be represented as a combination of simpler subparts. In this paper, we theoretically show that inductive biases on both the training framework and the data are needed…