paper-with-me

Papers

Spiking Associative Memory for Spatio-Temporal Patterns

2020-06-30 · Simon Davidson, Stephen B. Furber, Oliver Rhodes

Spike Timing Dependent Plasticity is form of learning that has been demonstrated in real cortical tissue, but attempts to use it for artificial systems have not produced good results. This paper seeks to remedy this with two significant advances. The first is the development a simple stochastic learning rule called cyclic STDP that can extract patterns encoded in the precise spiking times of a group of neurons. We show that a population of neurons endowed with this learning rule can act as an effective short-term associative memory, storing and reliably recalling a large set of pattern associations over an extended period of time. The second major theme examines the challenges associated with training a neuron to produce a spike at a precise time and for the fidelity of spike recall time to be maintained as further learning occurs. The strong constraint of working with precisely-timed spikes (so-called temporal coding) is mandated by the learning rule but is also consistent with the believe in the necessity of such an encoding scheme to render a spiking neural network a competitive solution for flexible intelligent systems in continuous learning environments. The encoding and learning rules are demonstrated in the design of a single-layer associative memory (an input layer consisting of 3,200 spiking neurons fully-connected to a similar sized population of memory neurons), which we simulate and characterise. Design considerations and clarification of the role of parameters under the control of the designer are explored.

📄 PDF Abstract BibTeX arXiv:2006.16684

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Training of spiking neural networks based on information theoretic costs

2016-02-15 · Oleg Y. Sinyavskiy

Spiking neural network is a type of artificial neural network in which neurons communicate between each other with spikes. Spikes are identical Boolean events characterized by the time of their arrival. A spiking neuron …

Reinforcement Learning

Information capacity of a network of spiking neurons

2019-11-24

We study a model of spiking neurons, with recurrent connections that result from learning a set of spatio-temporal patterns with a spike-timing dependent plasticity rule and a global inhibition. We investigate the abilit…

Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks

2024-01-08 · NeurIPS 2023 11 · Qi Xu, Yuyuan Gao, Jiangrong Shen, Yaxin Li 외

Spiking neural networks (SNNs) serve as one type of efficient model to process spatio-temporal patterns in time series, such as the Address-Event Representation data collected from Dynamic Vision Sensor (DVS). Although c…

Time Series

Perfect Associative Learning with Spike-Timing-Dependent Plasticity

2013-12-01 · NeurIPS 2013 12 · Christian Albers, Maren Westkott, Klaus Pawelzik

Recent extensions of the Perceptron, as e.g. the Tempotron, suggest that this theoretical concept is highly relevant also for understanding networks of spiking neurons in the brain. It is not known, however, how the comp…

Storing overlapping associative memories on latent manifolds in low-rank spiking networks

2024-11-26 · William F. Podlaski, Christian K. Machens

Associative memory architectures such as the Hopfield network have long been important conceptual and theoretical models for neuroscience and artificial intelligence. However, translating these abstract models into spiki…