Characterizing Learning in Spiking Neural Networks with Astrocyte-Like Units
Traditional artificial neural networks take inspiration from biological networks, using layers of neuron-like nodes to pass information for processing. More realistic models include spiking in the neural network, capturing the electrical characteristics more closely. However, a large proportion of brain cells are of the glial cell type, in particular astrocytes which have been suggested to play a role in performing computations. Here, we introduce a modified spiking neural network model with added astrocyte-like units in a neural network and asses their impact on learning. We implement the network as a liquid state machine and task the network with performing a chaotic time-series prediction task. We varied the number and ratio of neuron-like and astrocyte-like units in the network to examine the latter units effect on learning. We show that the combination of neurons and astrocytes together, as opposed to neural- and astrocyte-only networks, are critical for driving learning. Interestingly, we found that the highest learning rate was achieved when the ratio between astrocyte-like and neuron-like units was roughly 2 to 1, mirroring some estimates of the ratio of biological astrocytes to neurons. Our results demonstrate that incorporating astrocyte-like units which represent information across longer timescales can alter the learning rates of neural networks, and the proportion of astrocytes to neurons should be tuned appropriately to a given task.
Code (0)
등록된 구현이 없습니다.
Tasks
Time Series PredictionSimilar Papers 제목 키워드 기반
Dynamic image recognition in a spiking neuron network supplied by astrocytes
Mathematical model of spiking neuron network (SNN) supplied by astrocytes is investigated. The astrocytes are specific type of brain cells which are not electrically excitable but inducing chemical modulations of neurona…
Emergent dynamics in an astrocyte-neuronal network coupled via nitric oxide
In the brain, both neurons and glial cells work in conjunction with each other during information processing. Stimulation of neurons can cause calcium oscillations in astrocytes which in turn can affect neuronal calcium …
Controlling the spontaneous firing behavior of a neuron with astrocyte
Mounting evidence in recent years suggests that astrocytes, a sub-type of glial cells, not only serve metabolic and structural support for neurons and synapses but also play critical roles in regulation of proper functio…
Astrocyte-Enabled Advancements in Spiking Neural Networks for Large Language Modeling
Within the complex neuroarchitecture of the brain, astrocytes play crucial roles in development, structure, and metabolism. These cells regulate neural activity through tripartite synapses, directly impacting cognitive p…
Language ModelingLanguage ModellingText GenerationAstromorphic Self-Repair of Neuromorphic Hardware Systems
While neuromorphic computing architectures based on Spiking Neural Networks (SNNs) are increasingly gaining interest as a pathway toward bio-plausible machine learning, attention is still focused on computational units l…