paper-with-me

홈 › Papers

Meta-Referential Games to Learn Compositional Learning Behaviours

2022-07-16 · Kevin Denamganaï, Sondess Missaoui, James Alfred Walker

Human beings use compositionality to generalise from past experiences to novel experiences. We assume a separation of our experiences into fundamental atomic components that can be recombined in novel ways to support our ability to engage with novel experiences. We frame this as the ability to learn to generalise compositionally, and we will refer to behaviours making use of this ability as compositional learning behaviours (CLBs). A central problem to learning CLBs is the resolution of a binding problem (BP). While it is another feat of intelligence that human beings perform with ease, it is not the case for state-of-the-art artificial agents. Thus, in order to build artificial agents able to collaborate with human beings, we propose to develop a novel benchmark to investigate agents' abilities to exhibit CLBs by solving a domain-agnostic version of the BP. We take inspiration from the language emergence and grounding framework of referential games and propose a meta-learning extension of referential games, entitled Meta-Referential Games, and use this framework to build our benchmark, the Symbolic Behaviour Benchmark (S2B). We provide baseline results and error analysis showing that our benchmark is a compelling challenge that we hope will spur the research community towards developing more capable artificial agents.

📄 PDF Abstract BibTeX arXiv:2207.08012

Code (1)

Near32/Regym/tree/develop/benchmark/R2D2/SymbolicBehaviourBenchmark 공식 구현 pytorch

Tasks

Meta-LearningSystematic Generalization

Methods 이 논문이 사용한 방법론

Test 설명 없음
R2D2 Building on the recent successes of distributed training of RL agents, R2D2 is an RL approach that trains a RNN-based RL agents from distributed prioritized experience replay.…

Similar Papers 제목 키워드 기반

Visual Referential Games Further the Emergence of Disentangled Representations

2023-04-27 · Kevin Denamganaï, Sondess Missaoui, James Alfred Walker

Natural languages are powerful tools wielded by human beings to communicate information. Among their desirable properties, compositionality has been the main focus in the context of referential games and variants, as it …

DisentanglementInformativeness

On (Emergent) Systematic Generalisation and Compositionality in Visual Referential Games with Straight-Through Gumbel-Softmax Estimator

2020-12-19 · Kevin Denamganaï, James Alfred Walker

The drivers of compositionality in artificial languages that emerge when two (or more) agents play a non-visual referential game has been previously investigated using approaches based on the REINFORCE algorithm and the …

Sentence

Inductive Bias and Language Expressivity in Emergent Communication

2020-12-04 · Shangmin Guo, Yi Ren, Agnieszka Słowik, Kory Mathewson

Referential games and reconstruction games are the most common game types for studying emergent languages. We investigate how the type of the language game affects the emergent language in terms of: i) language compositi…

Inductive Bias

Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input

2018-04-11 · ICLR 2018 1 · Angeliki Lazaridou, Karl Moritz Hermann, Karl Tuyls, Stephen Clark

The ability of algorithms to evolve or learn (compositional) communication protocols has traditionally been studied in the language evolution literature through the use of emergent communication tasks. Here we scale up t…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Reference-Limited Compositional Zero-Shot Learning

2022-08-22 · Siteng Huang, Qiyao Wei, Donglin Wang

Compositional zero-shot learning (CZSL) refers to recognizing unseen compositions of known visual primitives, which is an essential ability for artificial intelligence systems to learn and understand the world. While con…

Compositional Zero-Shot LearningZero-Shot Learning