Representation Learning using Event-based STDP

2017-06-20 · Amirhossein Tavanaei, Timothee Masquelier, Anthony Maida

Although representation learning methods developed within the framework of traditional neural networks are relatively mature, developing a spiking representation model remains a challenging problem. This paper proposes an event-based method to train a feedforward spiking neural network (SNN) layer for extracting visual features. The method introduces a novel spike-timing-dependent plasticity (STDP) learning rule and a threshold adjustment rule both derived from a vector quantization-like objective function subject to a sparsity constraint. The STDP rule is obtained by the gradient of a vector quantization criterion that is converted to spike-based, spatio-temporally local update rules in a spiking network of leaky, integrate-and-fire (LIF) neurons. Independence and sparsity of the model are achieved by the threshold adjustment rule and by a softmax function implementing inhibition in the representation layer consisting of WTA-thresholded spiking neurons. Together, these mechanisms implement a form of spike-based, competitive learning. Two sets of experiments are performed on the MNIST and natural image datasets. The results demonstrate a sparse spiking visual representation model with low reconstruction loss comparable with state-of-the-art visual coding approaches, yet our rule is local in both time and space, thus biologically plausible and hardware friendly.

📄 PDF Abstract BibTeX arXiv:1706.06699

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization Representation Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Time-Integrated Spike-Timing-Dependent-Plasticity

2024-07-13 · William Gebhardt, Alexander G. Ororbia

In this work, we propose time-integrated spike-timing-dependent plasticity (TI-STDP), a mathematical model of synaptic plasticity that allows spiking neural networks to continuously adapt to sensory input streams in an u…

A New Look at Spike-Timing-Dependent Plasticity Networks for Spatio-Temporal Feature Learning

2021-11-01 · Ali Safa, Ilja Ocket, André Bourdoux, Hichem Sahli 외

We present new theoretical foundations for unsupervised Spike-Timing-Dependent Plasticity (STDP) learning in spiking neural networks (SNNs). In contrast to empirical parameter search used in most previous works, we provi…

Causal Spike Timing Dependent Plasticity Prevents Assembly Fusion in Recurrent Networks

2025-01-16 · Xinruo Yang, Brent Doiron

The organization of neurons into functionally related assemblies is a fundamental feature of cortical networks, yet our understanding of how these assemblies maintain distinct identities while sharing members remains lim…

Specificity

Even Faster SNN Simulation with Lazy+Event-driven Plasticity and Shared Atomics

2021-07-08 · Dennis Bautembach, Iason Oikonomidis, Antonis Argyros

We present two novel optimizations that accelerate clock-based spiking neural network (SNN) simulators. The first one targets spike timing dependent plasticity (STDP). It combines lazy- with event-driven plasticity and e…

Continuously Learning to Detect People on the Fly: A Bio-inspired Visual System for Drones

2022-02-16 · Ali Safa, Ilja Ocket, André Bourdoux, Hichem Sahli 외

This paper demonstrates for the first time that a biologically-plausible spiking neural network (SNN) equipped with Spike-Timing-Dependent Plasticity (STDP) can continuously learn to detect walking people on the fly usin…