An objective function for self-limiting neural plasticity rules
Self-organization provides a framework for the study of systems in which complex patterns emerge from simple rules, without the guidance of external agents or fine tuning of parameters. Within this framework, one can formulate a guiding principle for plasticity in the context of unsupervised learning, in terms of an objective function. In this work we derive Hebbian, self-limiting synaptic plasticity rules from such an objective function and then apply the rules to the non-linear bars problem.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Generating functionals for computational intelligence: the Fisher information as an objective function for self-limiting Hebbian learning rules
Generating functionals may guide the evolution of a dynamical system and constitute a possible route for handling the complexity of neural networks as relevant for computational intelligence. We propose and explore a new…
Network bottlenecks and task structure control the evolution of interpretable learning rules in a foraging agent
Developing reliable mechanisms for continuous local learning is a central challenge faced by biological and artificial systems. Yet, how the environmental factors and structural constraints on the learning network influe…
Meta-LearningStrong anti-Hebbian plasticity alters the convexity of network attractor landscapes
In this paper, we study recurrent neural networks in the presence of pairwise learning rules. We are specifically interested in how the attractor landscapes of such networks become altered as a function of the strength a…
A meta-learning approach to (re)discover plasticity rules that carve a desired function into a neural network
The search for biologically faithful synaptic plasticity rules has resulted in a large body of models. They are usually inspired by -- and fitted to -- experimental data, but they rarely produce neural dynamics that serv…
Meta-LearningOn-Chip Learning via Transformer In-Context Learning
Autoregressive decoder-only transformers have become key components for scalable sequence processing and generation models. However, the transformer's self-attention mechanism requires transferring prior token projection…
DecoderIn-Context Learning