paper-with-me

Papers

Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off

2023-01-30 · Yuchen Lian, Arianna Bisazza, Tessa Verhoef

Artificial learners often behave differently from human learners in the context of neural agent-based simulations of language emergence and change. A common explanation is the lack of appropriate cognitive biases in these learners. However, it has also been proposed that more naturalistic settings of language learning and use could lead to more human-like results. We investigate this latter account focusing on the word-order/case-marking trade-off, a widely attested language universal that has proven particularly hard to simulate. We propose a new Neural-agent Language Learning and Communication framework (NeLLCom) where pairs of speaking and listening agents first learn a miniature language via supervised learning, and then optimize it for communication via reinforcement learning. Following closely the setup of earlier human experiments, we succeed in replicating the trade-off with the new framework without hard-coding specific biases in the agents. We see this as an essential step towards the investigation of language universals with neural learners.

📄 PDF Abstract BibTeX arXiv:2301.13083

Code (1)

yuchen-lian/nellcom 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Is Structure Dependence Shaped for Efficient Communication?: A Case Study on Coordination

2024-10-14 · Kohei Kajikawa, Yusuke Kubota, Yohei Oseki

Natural language exhibits various universal properties. But why do these universals exist? One explanation is that they arise from functional pressures to achieve efficient communication, a view which attributes cross-li…

counterfactual

Reinforcement Communication Learning in Different Social Network Structures

2020-07-19 · ICML Workshop LaReL 2020 7 · Marina Dubova, Arseny Moskvichev, Robert Goldstone

Social network structure is one of the key determinants of human language evolution. Previous work has shown that the network of social interactions shapes decentralized learning in human groups, leading to the emergence…

Multi-agent Reinforcement Learning

From Grunts to Grammar: Emergent Language from Cooperative Foraging

2025-05-19 · Maytus Piriyajitakonkij, Rujikorn Charakorn, Weicheng Tao, Wei Pan 외

Early cavemen relied on gestures, vocalizations, and simple signals to coordinate, plan, avoid predators, and share resources. Today, humans collaborate using complex languages to achieve remarkable results. What drives …

Deep Reinforcement Learning

NeLLCom-X: A Comprehensive Neural-Agent Framework to Simulate Language Learning and Group Communication

2024-07-19 · Yuchen Lian, Tessa Verhoef, Arianna Bisazza

Recent advances in computational linguistics include simulating the emergence of human-like languages with interacting neural network agents, starting from sets of random symbols. The recently introduced NeLLCom framewor…

Bidirectional Emergent Language in Situated Environments

2024-08-26 · Cornelius Wolff, Julius Mayer, Elia Bruni, Xenia Ohmer

Emergent language research has made significant progress in recent years, but still largely fails to explore how communication emerges in more complex and situated multi-agent systems. Existing setups often employ a refe…

Diagnostic