paper-with-me

홈 › Papers

STCSNN: High energy efficiency spike-train level spiking neural networks with spatio-temporal conversion

2023-07-14 · Changqing Xu, Yi Liu, YinTang Yang

Brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest due to their low power features, high biological plausibility, and strong spatiotemporal information processing capability. Although adopting a surrogate gradient (SG) makes the non-differentiability SNN trainable, achieving comparable accuracy for ANNs and keeping low-power features simultaneously is still tricky. In this paper, we proposed an energy-efficient spike-train level spiking neural network with spatio-temporal conversion, which has low computational cost and high accuracy. In the STCSNN, spatio-temporal conversion blocks (STCBs) are proposed to keep the low power features of SNNs and improve accuracy. However, STCSNN cannot adopt backpropagation algorithms directly due to the non-differentiability nature of spike trains. We proposed a suitable learning rule for STCSNNs by deducing the equivalent gradient of STCB. We evaluate the proposed STCSNN on static and neuromorphic datasets, including Fashion-Mnist, Cifar10, Cifar100, TinyImageNet, and DVS-Cifar10. The experiment results show that our proposed STCSNN outperforms the state-of-the-art accuracy on nearly all datasets, using fewer time steps and being highly energy-efficient.

📄 PDF Abstract BibTeX arXiv:2307.07136

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SNN Spiking Neural Networks (SNNs) are a class of artificial neural networks inspired by the structure and functioning of the brain's neural networks. Unlike traditional…

Similar Papers 제목 키워드 기반

Training Energy-Efficient Deep Spiking Neural Networks with Time-to-First-Spike Coding

2021-06-04 · Seongsik Park, Sungroh Yoon

The tremendous energy consumption of deep neural networks (DNNs) has become a serious problem in deep learning. Spiking neural networks (SNNs), which mimic the operations in the human brain, have been studied as prominen…

A PyTorch-Compatible Spike Encoding Framework for Energy-Efficient Neuromorphic Applications

2025-04-15 · Alexandru Vasilache, Jona Scholz, Vincent Schilling, Sven Nitzsche 외

Spiking Neural Networks (SNNs) offer promising energy efficiency advantages, particularly when processing sparse spike trains. However, their incompatibility with traditional datasets, which consist of batches of input v…

reinforcement-learningReinforcement Learning

SPKLIP: Aligning Spike Video Streams with Natural Language

2025-05-19 · Yongchang Gao, Meiling Jin, Zhaofei Yu, Tiejun Huang 외

Spike cameras offer unique sensing capabilities but their sparse, asynchronous output challenges semantic understanding, especially for Spike Video-Language Alignment (Spike-VLA) where models like CLIP underperform due t…

Contrastive LearningFew-Shot Learning

Kirin: Improving ANN efficiency with SNN Hybridization

2026-02-09 · Chenyu Wang, Zhanglu Yan, Zhi Zhou, Xu Chen 외 arxiv

Artificial neural networks (ANNs), particularly large language models (LLMs), demonstrate powerful inference capabilities but consume substantial energy. Conversely, spiking neural networks (SNNs) exhibit exceptional ene…

Synaptic Modulation using Interspike Intervals Increases Energy Efficiency of Spiking Neural Networks

2024-08-06 · Dylan Adams, Magda Zajaczkowska, Ashiq Anjum, Andrea Soltoggio 외

Despite basic differences between Spiking Neural Networks (SNN) and Artificial Neural Networks (ANN), most research on SNNs involve adapting ANN-based methods for SNNs. Pruning (dropping connections) and quantization (re…

Quantization