paper-with-me

홈 › Papers

Q-SNNs: Quantized Spiking Neural Networks

2024-06-19 · Wenjie Wei, Yu Liang, Ammar Belatreche, Yichen Xiao, Honglin Cao, Zhenbang Ren, Guoqing Wang, Malu Zhang, Yang Yang

Brain-inspired Spiking Neural Networks (SNNs) leverage sparse spikes to represent information and process them in an asynchronous event-driven manner, offering an energy-efficient paradigm for the next generation of machine intelligence. However, the current focus within the SNN community prioritizes accuracy optimization through the development of large-scale models, limiting their viability in resource-constrained and low-power edge devices. To address this challenge, we introduce a lightweight and hardware-friendly Quantized SNN (Q-SNN) that applies quantization to both synaptic weights and membrane potentials. By significantly compressing these two key elements, the proposed Q-SNNs substantially reduce both memory usage and computational complexity. Moreover, to prevent the performance degradation caused by this compression, we present a new Weight-Spike Dual Regulation (WS-DR) method inspired by information entropy theory. Experimental evaluations on various datasets, including static and neuromorphic, demonstrate that our Q-SNNs outperform existing methods in terms of both model size and accuracy. These state-of-the-art results in efficiency and efficacy suggest that the proposed method can significantly improve edge intelligent computing.

📄 PDF Abstract BibTeX arXiv:2406.13672

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Methods 이 논문이 사용한 방법론

SNN Spiking Neural Networks (SNNs) are a class of artificial neural networks inspired by the structure and functioning of the brain's neural networks. Unlike traditional…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Spiking-Diffusion: Vector Quantized Discrete Diffusion Model with Spiking Neural Networks

2023-08-20 · Mingxuan Liu, Jie Gan, Rui Wen, Tao Li 외

Spiking neural networks (SNNs) have tremendous potential for energy-efficient neuromorphic chips due to their binary and event-driven architecture. SNNs have been primarily used in classification tasks, but limited explo…

DecoderImage Generation

Navigating Local Minima in Quantized Spiking Neural Networks

2022-02-15 · Jason K. Eshraghian, Corey Lammie, Mostafa Rahimi Azghadi, Wei D. Lu

Spiking and Quantized Neural Networks (NNs) are becoming exceedingly important for hyper-efficient implementations of Deep Learning (DL) algorithms. However, these networks face challenges when trained using error backpr…

Navigate

Noise Adaptor: Enhancing Low-Latency Spiking Neural Networks through Noise-Injected Low-Bit ANN Conversion

2024-11-26 · Chen Li, Bipin. Rajendran

We present Noise Adaptor, a novel method for constructing competitive low-latency spiking neural networks (SNNs) by converting noise-injected, low-bit artificial neural networks (ANNs). This approach builds on existing A…

MD-SNN: Membrane Potential-aware Distillation on Quantized Spiking Neural Network

2025-12-04 · Donghyun Lee, Abhishek Moitra, Youngeun Kim, Ruokai Yin 외 arxiv

Spiking Neural Networks (SNNs) offer a promising and energy-efficient alternative to conventional neural networks, thanks to their sparse binary activation. However, they face challenges regarding memory and computation …

Knowledge Distillation

QB-LIF: Learnable-Scale Quantized Burst Neurons for Efficient SNNs

2026-04-28 · Dewei Bai, Hongxiang Peng, Jiajun Mei, Yang Ren 외 arxiv

Binary spike coding enables sparse and event-driven computation in spiking neural networks (SNNs), yet its 1-bit-per-timestep representation fundamentally limits information throughput. This bottleneck becomes increasing…