Deriving dynamical systems for language based on the Tolerance Principle
In this research note, I derive explicit dynamical systems for language within an acquisition-driven framework (Niyogi \& Berwick, 1997; Niyogi, 2006) assuming that children/learners follow the Tolerance Principle (Yang, 2016) to determine whether a rule is productive during the process of language acquisition. I consider different theoretical parameters such as population size (finite vs. infinite) and the number of previous generations that provide learners with data. Multiple simulations of the dynamics obtained here and applications to diacrhonic language data are in preparation, so they are not included in this first note.
Code (0)
등록된 구현이 없습니다.
Tasks
Language AcquisitionSimilar Papers 제목 키워드 기반
Noisy dynamical systems evolve error correcting codes and modularity
Noise is a ubiquitous feature of the physical world. As a result, the first prerequisite of life is fault tolerance: maintaining integrity of state despite external bombardment. Recent experimental advances have revealed…
Tolerance Principle and Small Language Model Learning
Modern language models like GPT-3, BERT, and LLaMA require massive training data, yet with sufficient training they reliably learn to distinguish grammatical from ungrammatical sentences. Children aged as young as 14 mon…
PAC-Bayesian theory for stochastic LTI systems
In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dy…
BIG-bench Machine LearningState Space ModelsUniversal Simulation of Stable Dynamical Systems by Recurrent Neural Nets
It is well-known that continuous-time recurrent neural nets are universal approximators for continuous-time dynamical systems. However, existing results provide approximation guarantees only for finite-time trajectories.…
Online Bayesian Experimental Design for Partially Observed Dynamical Systems
Bayesian experimental design (BED) provides a principled framework for optimizing data collection by choosing experiments that are maximally informative about unknown parameters. However, existing methods cannot deal wit…
Stochastic Optimization