paper-with-me

홈 › Papers

Canonic Signed Spike Coding for Efficient Spiking Neural Networks

2024-08-30 · Yiwen Gu, Junchuan Gu, Haibin Shen, Kejie Huang

Spiking Neural Networks (SNNs) seek to mimic the spiking behavior of biological neurons and are expected to play a key role in the advancement of neural computing and artificial intelligence. The conversion of Artificial Neural Networks (ANNs) to SNNs is the most widely used training method, which ensures that the resulting SNNs perform comparably to ANNs on large-scale datasets. The efficiency of these conversion-based SNNs is often determined by the neural coding schemes. Current schemes typically use spike count or timing for encoding, which is linearly related to ANN activations and increases the required number of time steps. To address this limitation, we propose a novel Canonic Signed Spike (CSS) coding scheme. This method incorporates non-linearity into the encoding process by weighting spikes at each step of neural computation, thereby increasing the information encoded in spikes. We identify the temporal coupling phenomenon arising from weighted spikes and introduce negative spikes along with a Ternary Self-Amplifying (TSA) neuron model to mitigate the issue. A one-step silent period is implemented during neural computation, achieving high accuracy with low latency. We apply the proposed methods to directly convert full-precision ANNs and evaluate performance on CIFAR-10 and ImageNet datasets. Our experimental results demonstrate that the CSS coding scheme effectively compresses time steps for coding and reduces inference latency with minimal conversion loss.

📄 PDF Abstract BibTeX arXiv:2408.17245

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

BSViT: A Burst Spiking Vision Transformer for Expressive and Efficient Visual Representation Learning

2026-04-25 · Hongxiang Peng, Dewei Bai, Hong Qu arxiv

Spiking Vision Transformers (S-ViTs) offer a promising framework for energy-efficient visual learning. However, existing designs remain limited by two fundamental issues: the restricted information capacity of binary spi…

Representation LearningEvent-based vision

Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks

2023-09-18 · Zeyang Song, Jibin Wu, Malu Zhang, Mike Zheng Shou 외

Brain-inspired spiking neural networks (SNNs) have demonstrated great potential for temporal signal processing. However, their performance in speech processing remains limited due to the lack of an effective auditory fro…

Keyword SpottingSpeaker Identification

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

2024-06-05 · Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao 외

Towards energy-efficient artificial intelligence similar to the human brain, the bio-inspired spiking neural networks (SNNs) have advantages of biological plausibility, event-driven sparsity, and binary activation. Recen…

Language ModelingLanguage Modelling

Spiking-GAN: A Spiking Generative Adversarial Network Using Time-To-First-Spike Coding

2021-06-29 · Vineet Kotariya, Udayan Ganguly

Spiking Neural Networks (SNNs) have shown great potential in solving deep learning problems in an energy-efficient manner. However, they are still limited to simple classification tasks. In this paper, we propose Spiking…

Generative Adversarial Network

Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training

2025-12-03 · Luu Trong Nhan, Luu Trung Duong, Pham Ngoc Nam, Truong Cong Thang arxiv

Spiking neural networks (SNNs) have emerged as a promising direction in both computational neuroscience and artificial intelligence, offering advantages such as strong biological plausibility and low energy consumption o…