paper-with-me

Papers

Developmentally motivated emergence of compositional communication via template transfer

2019-10-04 · Tomasz Korbak, Julian Zubek, Łukasz Kuciński, Piotr Miłoś, Joanna Rączaszek-Leonardi

This paper explores a novel approach to achieving emergent compositional communication in multi-agent systems. We propose a training regime implementing template transfer, the idea of carrying over learned biases across contexts. In our method, a sender-receiver pair is first trained with disentangled loss functions and then the receiver is transferred to train a new sender with a standard loss. Unlike other methods (e.g. the obverter algorithm), our approach does not require imposing inductive biases on the architecture of the agents. We experimentally show the emergence of compositional communication using topographical similarity, zero-shot generalization and context independence as evaluation metrics. The presented approach is connected to an important line of work in semiotics and developmental psycholinguistics: it supports a conjecture that compositional communication is scaffolded on simpler communication protocols.

📄 PDF Abstract BibTeX arXiv:1910.06079

Code (1)

tomekkorbak/compositional-communication-via-template-transfer 공식 구현 pytorch

Tasks

Zero-shot Generalization

Similar Papers 제목 키워드 기반

Measuring non-trivial compositionality in emergent communication

2020-10-28 · Tomasz Korbak, Julian Zubek, Joanna Rączaszek-Leonardi

Compositionality is an important explanatory target in emergent communication and language evolution. The vast majority of computational models of communication account for the emergence of only a very basic form of comp…

Intrinsically Motivated Compositional Language Emergence

2020-12-09 · Rishi Hazra, Sonu Dixit, Sayambhu Sen

Recently, there has been a great deal of research in emergent communication on artificial agents interacting in simulated environments. Recent studies have revealed that, in general, emergent languages do not follow the …

Language Acquisition

Emergence of compositional language in communication through noisy channel

2020-06-12 · ICML Workshop LaReL 2020 7 · Łukasz Kuciński, Paweł Kołodziej, Piotr Miłoś

In this paper, we investigate how communication through a noisy channel can lead to the emergence of compositional language. Our approach is $\mbox{end-to-end}$, allows for different inductive biases on the agents’ archi…

Emergence of Grounded Compositional Language in Multi-Agent Populations

2017-03-15 · Igor Mordatch, Pieter Abbeel

By capturing statistical patterns in large corpora, machine learning has enabled significant advances in natural language processing, including in machine translation, question answering, and sentiment analysis. However,…

Machine TranslationQuestion AnsweringSentiment AnalysisTranslation

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication

2021-11-11 · NeurIPS 2021 12 · Łukasz Kuciński, Tomasz Korbak, Paweł Kołodziej, Piotr Miłoś

Communication is compositional if complex signals can be represented as a combination of simpler subparts. In this paper, we theoretically show that inductive biases on both the training framework and the data are needed…