paper-with-me

Papers

Bidirectional Emergent Language in Situated Environments

2024-08-26 · Cornelius Wolff, Julius Mayer, Elia Bruni, Xenia Ohmer

Emergent language research has made significant progress in recent years, but still largely fails to explore how communication emerges in more complex and situated multi-agent systems. Existing setups often employ a reference game, which limits the range of language emergence phenomena that can be studied, as the game consists of a single, purely language-based interaction between the agents. In this paper, we address these limitations and explore the emergence and utility of token-based communication in open-ended multi-agent environments, where situated agents interact with the environment through movement and communication over multiple time-steps. Specifically, we introduce two novel cooperative environments: Multi-Agent Pong and Collectors. These environments are interesting because optimal performance requires the emergence of a communication protocol, but moderate success can be achieved without one. By employing various methods from explainable AI research, such as saliency maps, perturbation, and diagnostic classifiers, we are able to track and interpret the agents' language channel use over time. We find that the emerging communication is sparse, with the agents only generating meaningful messages and acting upon incoming messages in states where they cannot succeed without coordination.

📄 PDF Abstract BibTeX arXiv:2408.14649

Code (0)

등록된 구현이 없습니다.

Tasks

Diagnostic

Similar Papers 제목 키워드 기반

Evolving reservoir computers reveals bidirectional coupling between predictive power and emergent dynamics

2024-06-27 · Hanna M. Tolle, Andrea I Luppi, Anil K. Seth, Pedro A. M. Mediano

Biological neural networks can perform complex computations to predict their environment, far above the limited predictive capabilities of individual neurons. While conventional approaches to understanding these computat…

Prediction

Like a Baby: Visually Situated Neural Language Acquisition

2018-05-29 · ACL 2019 7 · Alexander G. Ororbia, Ankur Mali, Matthew A. Kelly, David Reitter

We examine the benefits of visual context in training neural language models to perform next-word prediction. A multi-modal neural architecture is introduced that outperform its equivalent trained on language alone with …

Language AcquisitionLanguage ModelingLanguage Modelling

Bidirectional Language Models Are Also Few-shot Learners

2022-09-29 · Ajay Patel, Bryan Li, Mohammad Sadegh Rasooli, Noah Constant 외

Large language models such as GPT-3 (Brown et al., 2020) can perform arbitrary tasks without undergoing fine-tuning after being prompted with only a few labeled examples. An arbitrary task can be reformulated as a natura…

DenoisingLanguage ModelingLanguage ModellingMachine Translation+3

ELCC: the Emergent Language Corpus Collection

2024-07-04 · Brendon Boldt, David Mortensen

We introduce the Emergent Language Corpus Collection (ELCC): a collection of corpora generated from open source implementations of emergent communication systems across the literature. These systems include a variety of …

Transfer Learning

Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models

2023-10-30 · Ziqiao Ma, Jacob Sansom, Run Peng, Joyce Chai

Large Language Models (LLMs) have generated considerable interest and debate regarding their potential emergence of Theory of Mind (ToM). Several recent inquiries reveal a lack of robust ToM in these models and pose a pr…

PositionTheory of Mind Modeling