paper-with-me

홈 › Papers

Visual Theory of Mind Enables the Invention of Proto-Writing

2025-02-03 · Benjamin A. Spiegel, Lucas Gelfond, George Konidaris

Symbolic writing systems are graphical semiotic codes that are ubiquitous in modern society but are otherwise absent in the animal kingdom. Anthropological evidence suggests that the earliest forms of some writing systems originally consisted of iconic pictographs, which signify their referent via visual resemblance. While previous studies have examined the emergence and, separately, the evolution of pictographic systems through a computational lens, most employ non-naturalistic methodologies that make it difficult to draw clear analogies to human and animal cognition. We develop a multi-agent reinforcement learning testbed for emergent communication called a Signification Game, and formulate a model of inferential communication that enables agents to leverage visual theory of mind to communicate actions using pictographs. Our model, which is situated within a broader formalism for animal communication, sheds light on the cognitive and cultural processes underlying the emergence of proto-writing.

📄 PDF Abstract BibTeX arXiv:2502.01568

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Similar Papers 제목 키워드 기반

Theory reconstruction: a representation learning view on predicate invention

2016-06-28 · Sebastijan Dumancic, Wannes Meert, Hendrik Blockeel

With this positional paper we present a representation learning view on predicate invention. The intention of this proposal is to bridge the relational and deep learning communities on the problem of predicate invention.…

Representation Learning

Revisiting the Evaluation of Theory of Mind through Question Answering

2019-11-01 · IJCNLP 2019 11 · Matthew Le, Y-Lan Boureau, Maximilian Nickel

Theory of mind, i.e., the ability to reason about intents and beliefs of agents is an important task in artificial intelligence and central to resolving ambiguous references in natural language dialogue. In this work, we…

Question Answering

Mind-of-Director: Multi-modal Agent-Driven Film Previsualization via Collaborative Decision-Making

2026-03-16 · Shufeng Nan, Mengtian Li, Sixiao Zheng, Yuwei Lu 외 arxiv

We present Mind-of-Director, a multi-modal agent-driven framework for film previz that models the collaborative decision-making process of a film production team. Given a creative idea, Mind-of-Director orchestrates mult…

CHARTOM: A Visual Theory-of-Mind Benchmark for Multimodal Large Language Models

2024-08-26 · Shubham Bharti, Shiyun Cheng, Jihyun Rho, Jianrui Zhang 외

We introduce CHARTOM, a visual theory-of-mind benchmark for multimodal large language models. CHARTOM consists of specially designed data visualizing charts. Given a chart, a language model needs to not only correctly co…

Language ModelingLanguage Modelling

BeliefNest: A Joint Action Simulator for Embodied Agents with Theory of Mind

2025-05-18 · Rikunari Sagara, Koichiro Terao, Naoto Iwahashi

This paper introduces an open-source simulator, BeliefNest, designed to enable embodied agents to perform collaborative tasks by leveraging Theory of Mind. BeliefNest dynamically and hierarchically constructs simulators …

Minecraft