paper-with-me

홈 › Papers

Coarse scale representation of spiking neural networks: backpropagation through spikes and application to neuromorphic hardware

2020-07-13 · Angel Yanguas-Gil

In this work we explore recurrent representations of leaky integrate and fire neurons operating at a timescale equal to their absolute refractory period. Our coarse time scale approximation is obtained using a probability distribution function for spike arrivals that is homogeneously distributed over this time interval. This leads to a discrete representation that exhibits the same dynamics as the continuous model, enabling efficient large scale simulations and backpropagation through the recurrent implementation. We use this approach to explore the training of deep spiking neural networks including convolutional, all-to-all connectivity, and maxpool layers directly in Pytorch. We found that the recurrent model leads to high classification accuracy using just 4-long spike trains during training. We also observed a good transfer back to continuous implementations of leaky integrate and fire neurons. Finally, we applied this approach to some of the standard control problems as a first step to explore reinforcement learning using neuromorphic chips.

📄 PDF Abstract BibTeX arXiv:2007.06176

Code (1)

anglyan/spikingtorch 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation

2024-10-15 · Chengting Yu, Lei Liu, Gaoang Wang, Erping Li 외

Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Mot…

Event-Based Backpropagation can compute Exact Gradients for Spiking Neural Networks

2020-09-17 · Timo C. Wunderlich, Christian Pehle

Spiking neural networks combine analog computation with event-based communication using discrete spikes. While the impressive advances of deep learning are enabled by training non-spiking artificial neural networks using…

Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm

2025-02-19 · Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpr…

Computational Efficiency

Effective and Efficient Computation with Multiple-timescale Spiking Recurrent Neural Networks

2020-05-24 · Bojian Yin, Federico Corradi, Sander M. Bohté

The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is motivating the search for high-performance and efficient spiking neural networks to run on this hardware. However, compared to classical…

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

2021-06-13 · Alpha Renner, Forrest Sheldon, Anatoly Zlotnik, Louis Tao 외

The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large-scale integrated (VLSI) circuits capable of fast, low-power information processin…

BIG-bench Machine LearningEdge-computingImage Classification