paper-with-me

Papers

On the Correspondence between Compositionality and Imitation in Emergent Neural Communication

2023-05-22 · Emily Cheng, Mathieu Rita, Thierry Poibeau

Compositionality is a hallmark of human language that not only enables linguistic generalization, but also potentially facilitates acquisition. When simulating language emergence with neural networks, compositionality has been shown to improve communication performance; however, its impact on imitation learning has yet to be investigated. Our work explores the link between compositionality and imitation in a Lewis game played by deep neural agents. Our contributions are twofold: first, we show that the learning algorithm used to imitate is crucial: supervised learning tends to produce more average languages, while reinforcement learning introduces a selection pressure toward more compositional languages. Second, our study reveals that compositional languages are easier to imitate, which may induce the pressure toward compositional languages in RL imitation settings.

📄 PDF Abstract BibTeX arXiv:2305.12941

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation Learning

Similar Papers 제목 키워드 기반

Measuring non-trivial compositionality in emergent communication

2020-10-28 · Tomasz Korbak, Julian Zubek, Joanna Rączaszek-Leonardi

Compositionality is an important explanatory target in emergent communication and language evolution. The vast majority of computational models of communication account for the emergence of only a very basic form of comp…

Concept-Best-Matching: Evaluating Compositionality in Emergent Communication

2024-03-17 · Boaz Carmeli, Yonatan Belinkov, Ron Meir

Artificial agents that learn to communicate in order to accomplish a given task acquire communication protocols that are typically opaque to a human. A large body of work has attempted to evaluate the emergent communicat…

Biology and Compositionality: Empirical Considerations for Emergent-Communication Protocols

2019-11-26 · Travis LaCroix

Significant advances have been made in artificial systems by using biological systems as a guide. However, there is often little interaction between computational models for emergent communication and biological models o…

BIG-bench Machine Learning

Inductive Bias and Language Expressivity in Emergent Communication

2020-12-04 · Shangmin Guo, Yi Ren, Agnieszka Słowik, Kory Mathewson

Referential games and reconstruction games are the most common game types for studying emergent languages. We investigate how the type of the language game affects the emergent language in terms of: i) language compositi…

Inductive Bias

Intrinsically Motivated Compositional Language Emergence

2020-12-09 · Rishi Hazra, Sonu Dixit, Sayambhu Sen

Recently, there has been a great deal of research in emergent communication on artificial agents interacting in simulated environments. Recent studies have revealed that, in general, emergent languages do not follow the …

Language Acquisition