paper-with-me

홈 › Papers

Differential Coding for Training-Free ANN-to-SNN Conversion

2025-03-01 · Zihan Huang, Wei Fang, Tong Bu, Peng Xue, Zecheng Hao, Wenxuan Liu, Yuanhong Tang, Zhaofei Yu, Tiejun Huang

Spiking Neural Networks (SNNs) exhibit significant potential due to their low energy consumption. Converting Artificial Neural Networks (ANNs) to SNNs is an efficient way to achieve high-performance SNNs. However, many conversion methods are based on rate coding, which requires numerous spikes and longer time-steps compared to directly trained SNNs, leading to increased energy consumption and latency. This article introduces differential coding for ANN-to-SNN conversion, a novel coding scheme that reduces spike counts and energy consumption by transmitting changes in rate information rather than rates directly, and explores its application across various layers. Additionally, the threshold iteration method is proposed to optimize thresholds based on activation distribution when converting Rectified Linear Units (ReLUs) to spiking neurons. Experimental results on various Convolutional Neural Networks (CNNs) and Transformers demonstrate that the proposed differential coding significantly improves accuracy while reducing energy consumption, particularly when combined with the threshold iteration method, achieving state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2503.00301

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Training-Free ANN-to-SNN Conversion for High-Performance Spiking Transformer

2025-08-11 · Jingya Wang, Xin Deng, Wenjie Wei, Dehao Zhang 외 arxiv

Leveraging the event-driven paradigm, Spiking Neural Networks (SNNs) offer a promising approach for energy-efficient Transformer architectures.While ANN-to-SNN conversion avoids the high training cost of directly trained…

Generalization of Spectrum Differential based Direct Waveform Modification for Voice Conversion

2019-07-27

We present a modification to the spectrum differential based direct waveform modification for voice conversion (DIFFVC) so that it can be directly applied as a waveform generation module to voice conversion models. The r…

Voice Conversion

MrRoPE: Mixed-radix Rotary Position Embedding

2026-01-28 · Qingyuan Tian, Wenhong Zhu, Xiaoran Liu, Xiaofeng Wang 외 arxiv

Rotary Position Embedding (RoPE)-extension refers to modifying or generalizing the Rotary Position Embedding scheme to handle longer sequences than those encountered during pre-training. However, current extension strate…

Text-free non-parallel many-to-many voice conversion using normalising flows

2022-03-15 · Thomas Merritt, Abdelhamid Ezzerg, Piotr Biliński, Magdalena Proszewska 외

Non-parallel voice conversion (VC) is typically achieved using lossy representations of the source speech. However, ensuring only speaker identity information is dropped whilst all other information from the source speec…

Normalising FlowsSpeech Synthesistext-to-speechText to Speech+2

One-Spike SNN: Single-Spike Phase Coding with Base Manipulation for ANN-to-SNN Conversion Loss Minimization

2024-01-30 · Sangwoo Hwang, Jaeha Kung

As spiking neural networks (SNNs) are event-driven, energy efficiency is higher than conventional artificial neural networks (ANNs). Since SNN delivers data through discrete spikes, it is difficult to use gradient method…