Cultural evolution via iterated learning and communication explains efficient color naming systems
It has been argued that semantic systems reflect pressure for efficiency, and a current debate concerns the cultural evolutionary process that produces this pattern. We consider efficiency as instantiated in the Information Bottleneck (IB) principle, and a model of cultural evolution that combines iterated learning and communication. We show that this model, instantiated in neural networks, converges to color naming systems that are efficient in the IB sense and similar to human color naming systems. We also show that some other proposals such as iterated learning alone, communication alone, or the greater learnability of convex categories, do not yield the same outcome as clearly. We conclude that the combination of iterated learning and communication provides a plausible means by which human semantic systems become efficient.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
How a Generation Was Misled About Natural Selection
This article explains how natural selection works and how it has been inappropriately applied to the description of cultural change. It proposes an alternative evolutionary explanation for cultural evolution that describ…
Language Detection for Transliterated Content
In the contemporary digital era, the Internet functions as an unparalleled catalyst, dismantling geographical and linguistic barriers particularly evident in texting. This evolution facilitates global communication, tran…
Language IdentificationTransliterationModel Collapse as Cultural Evolution
Model collapse, the progressive degradation of LLMs trained on their own outputs, has been characterized statistically but lacks a linguistic explanation for which structures degrade, in what order, and why. We show that…
Evolution and compression in LLMs: On the emergence of human-aligned categorization
Converging evidence suggests that human systems of semantic categories achieve near-optimal compression via the Information Bottleneck (IB) complexity-accuracy tradeoff. Large language models (LLMs) are not trained for t…
Bias Amplification in Language Model Evolution: An Iterated Learning Perspective
With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods all…
Language ModelingLanguage Modelling