paper-with-me

홈 › Papers

Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes

2022-04-28 · Yang Li, Yi Zeng

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers. While the training of spiking neural networks is still an open problem. One effective way is to map the weight of trained ANN to SNN to achieve high reasoning ability. However, the converted spiking neural network often suffers from performance degradation and a considerable time delay. To speed up the inference process and obtain higher accuracy, we theoretically analyze the errors in the conversion process from three perspectives: the differences between IF and ReLU, time dimension, and pooling operation. We propose a neuron model for releasing burst spikes, a cheap but highly efficient method to solve residual information. In addition, Lateral Inhibition Pooling (LIPooling) is proposed to solve the inaccuracy problem caused by MaxPooling in the conversion process. Experimental results on CIFAR and ImageNet demonstrate that our algorithm is efficient and accurate. For example, our method can ensure nearly lossless conversion of SNN and only use about 1/10 (less than 100) simulation time under 0.693$\times$ energy consumption of the typical method. Our code is available at https://github.com/Brain-Inspired-Cognitive-Engine/Conversion_Burst.

📄 PDF Abstract BibTeX arXiv:2204.13271

Code (1)

brain-inspired-cognitive-engine/conversion_burst 공식 구현 pytorch

Tasks

Efficient Neural Network

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Fast and Efficient Information Transmission with Burst Spikes in Deep Spiking Neural Networks

2018-09-10 · Seongsik Park, Seijoon Kim, Hyeokjun Choe, Sungroh Yoon

The spiking neural networks (SNNs) are considered as one of the most promising artificial neural networks due to their energy efficient computing capability. Recently, conversion of a trained deep neural network to an SN…

Image Classification

Optimized spiking neurons classify images with high accuracy through temporal coding with two spikes

2020-01-31 · Christoph Stöckl, Wolfgang Maass

Spike-based neuromorphic hardware promises to reduce the energy consumption of image classification and other deep learning applications, particularly on mobile phones or other edge devices. However, direct training of d…

General Classificationimage-classificationImage Classification

T2FSNN: Deep Spiking Neural Networks with Time-to-first-spike Coding

2020-03-26 · Seongsik Park, Seijoon Kim, Byunggook Na, Sungroh Yoon

Spiking neural networks (SNNs) have gained considerable interest due to their energy-efficient characteristics, yet lack of a scalable training algorithm has restricted their applicability in practical machine learning p…

BSViT: A Burst Spiking Vision Transformer for Expressive and Efficient Visual Representation Learning

2026-04-25 · Hongxiang Peng, Dewei Bai, Hong Qu arxiv

Spiking Vision Transformers (S-ViTs) offer a promising framework for energy-efficient visual learning. However, existing designs remain limited by two fundamental issues: the restricted information capacity of binary spi…

Representation LearningEvent-based vision

Canonic Signed Spike Coding for Efficient Spiking Neural Networks

2024-08-30 · Yiwen Gu, Junchuan Gu, Haibin Shen, Kejie Huang

Spiking Neural Networks (SNNs) seek to mimic the spiking behavior of biological neurons and are expected to play a key role in the advancement of neural computing and artificial intelligence. The conversion of Artificial…