paper-with-me

홈 › Papers

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network

2024-12-18 · Ziqing Wang, Yuetong Fang, Jiahang Cao, Hongwei Ren, Renjing Xu

Spiking Neural Networks (SNNs) are seen as an energy-efficient alternative to traditional Artificial Neural Networks (ANNs), but the performance gap remains a challenge. While this gap is narrowing through ANN-to-SNN conversion, substantial computational resources are still needed, and the energy efficiency of converted SNNs cannot be ensured. To address this, we present a unified training-free conversion framework that significantly enhances both the performance and efficiency of converted SNNs. Inspired by the biological nervous system, we propose a novel Adaptive-Firing Neuron Model (AdaFire), which dynamically adjusts firing patterns across different layers to substantially reduce the Unevenness Error - the primary source of error of converted SNNs within limited inference timesteps. We further introduce two efficiency-enhancing techniques: the Sensitivity Spike Compression (SSC) technique for reducing spike operations, and the Input-aware Adaptive Timesteps (IAT) technique for decreasing latency. These methods collectively enable our approach to achieve state-of-the-art performance while delivering significant energy savings of up to 70.1%, 60.3%, and 43.1% on CIFAR-10, CIFAR-100, and ImageNet datasets, respectively. Extensive experiments across 2D, 3D, event-driven classification tasks, object detection, and segmentation tasks, demonstrate the effectiveness of our method in various domains. The code is available at: https://github.com/bic-L/burst-ann2snn.

📄 PDF Abstract BibTeX arXiv:2412.16219

Code (1)

bic-l/burst-ann2snn 공식 구현 pytorch

Tasks

object-detectionObject Detection

Similar Papers 제목 키워드 기반

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networks

2023-11-24 · Ziqing Wang, Yuetong Fang, Jiahang Cao, Renjing Xu

Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs). Despite this, bridging the performance gap with ANNs in practical scenarios remain…

Event-based visionobject-detectionObject Detection

Efficient Converted Spiking Neural Network for 3D and 2D Classification

2023-01-01 · ICCV 2023 1 · Yuxiang Lan, Yachao Zhang, Xu Ma, Yanyun Qu 외

Spiking Neural Networks (SNNs) have attracted enormous research interest due to their low-power and biologically plausible nature. Existing ANN-SNN conversion methods can achieve lossless conversion by converting a w…

image-classificationImage ClassificationPoint Cloud Classification

Faster and Stronger: When ANN-SNN Conversion Meets Parallel Spiking Calculation

2024-12-18 · Zecheng Hao, Zhaofei Yu, Tiejun Huang

Spiking Neural Network (SNN), as a brain-inspired and energy-efficient network, is currently facing the pivotal challenge of exploring a suitable and efficient learning framework. The predominant training methodologies, …

FAS: Fast ANN-SNN Conversion for Spiking Large Language Models

2025-02-06 · Long Chen, Xiaotian Song, Andy Song, Badong Chen 외

Spiking Large Language Models have been shown as a good alternative to LLMs in various scenarios. Existing methods for creating Spiking LLMs, i.e., direct training and ANN-SNN conversion, often suffer from performance de…

A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration

2021-06-13 · Yuhang Li, Shikuang Deng, Xin Dong, Ruihao Gong 외

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation whi…