Emergent Self-Attention from Astrocyte-Gated Associative Memory Dynamics
We introduce a Hopfield-type associative memory in which effective connectivity is multiplicatively modulated by astrocytic gains evolving under an entropy-regularized replicator equation. The coupled neuron-astrocyte dynamics admit a Lyapunov function, ensuring global convergence. At fixed points, astrocytic gains implement a softmax-normalized allocation over pattern similarity scores, yielding a mechanistic realization of self-attention as emergent routing on the gain simplex. In regimes of high memory load and interference, the model significantly improves retrieval accuracy relative to classical Hopfield dynamics and recent neuron-astrocyte baselines. These results establish a dynamical systems framework linking glial modulation, competitive resource allocation, and attention-like computation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Neuron-Astrocyte Associative Memory
Astrocytes, the most abundant type of glial cell, play a fundamental role in memory. Despite most hippocampal synapses being contacted by an astrocyte, there are no current theories that explain how neurons, synapses, an…
Situation-based memory in spiking neuron-astrocyte network
Mammalian brains operate in a very special surrounding: to survive they have to react quickly and effectively to the pool of stimuli patterns previously recognized as danger. Many learning tasks often encountered by livi…
RetrievalRMAAT: Astrocyte-Inspired Memory Compression and Replay for Efficient Long-Context Transformers
The quadratic complexity of self-attention mechanism presents a significant impediment to applying Transformer models to long sequences. This work explores computational principles derived from astrocytes-glial cells cri…
Emergent dynamics in an astrocyte-neuronal network coupled via nitric oxide
In the brain, both neurons and glial cells work in conjunction with each other during information processing. Stimulation of neurons can cause calcium oscillations in astrocytes which in turn can affect neuronal calcium …
Delving Deeper Into Astromorphic Transformers
Preliminary attempts at incorporating the critical role of astrocytes - cells that constitute more than 50\% of human brain cells - in brain-inspired neuromorphic computing remain in infancy. This paper seeks to delve de…
image-classificationImage ClassificationText Generation