paper-with-me

홈 › Papers

Hybrid Layer-Wise ANN-SNN With Surrogate Spike Encoding-Decoding Structure

2025-09-29 · Nhan T. Luu, Duong T. Luu, Pham Ngoc Nam, Truong Cong Thang arxiv

Spiking Neural Networks (SNNs) have gained significant traction in both computational neuroscience and artificial intelligence for their potential in energy-efficient computing. In contrast, artificial neural networks (ANNs) excel at gradient-based optimization and high accuracy. This contrast has consequently led to a growing subfield of hybrid ANN-SNN research. However, existing hybrid approaches often rely on either a strict separation between ANN and SNN components or employ SNN-only encoders followed by ANN classifiers due to the constraints of non-differentiability of spike encoding functions, causing prior hybrid architectures to lack deep layer-wise cooperation during backpropagation. To address this gap, we propose a novel hybrid ANN-SNN framework that integrates layer-wise encode-decode SNN blocks within conventional ANN pipelines. Central to our method is the use of surrogate gradients for a bit-plane-based spike encoding function, enabling end-to-end differentiable training across ANN and SNN layers. This design achieves competitive accuracy with state-of-the-art pure ANN and SNN models while retaining the potential efficiency and temporal representation benefits of spiking computation. To the best of our knowledge, this is the first implementation of a surrogate gradient for bit plane coding specifically and spike encoder interface in general to be utilized in the context of hybrid ANN-SNN, successfully leading to a new class of hybrid models that pave new directions for future research.

📄 PDF Abstract BibTeX arXiv:2509.24411

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Training Energy-Efficient Deep Spiking Neural Networks with Single-Spike Hybrid Input Encoding

2021-07-26 · Gourav Datta, Souvik Kundu, Peter A. Beerel

Spiking Neural Networks (SNNs) have emerged as an attractive alternative to traditional deep learning frameworks, since they provide higher computational efficiency in event driven neuromorphic hardware. However, the sta…

Computational Efficiencyimage-classificationImage Classification

Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training

2025-12-03 · Luu Trong Nhan, Luu Trung Duong, Pham Ngoc Nam, Truong Cong Thang arxiv

Spiking neural networks (SNNs) have emerged as a promising direction in both computational neuroscience and artificial intelligence, offering advantages such as strong biological plausibility and low energy consumption o…

NeuromorphicRx: From Neural to Spiking Receiver

2025-12-04 · Ankit Gupta, Onur Dizdar, Yun Chen, Fehmi Emre Kadan 외 arxiv

In this work, we propose a novel energy-efficient spiking neural network (SNN)-based receiver for 5G-NR OFDM system, called neuromorphic receiver (NeuromorphicRx), replacing the channel estimation, equalization and symbo…

Supervised Spike Agreement Dependent Plasticity for Fast Local Learning in Spiking Neural Networks

2026-01-13 · Gouri Lakshmi S, Athira Chandrasekharan, Harshit Kumar, Muhammed Sahad E 외 arxiv

Spike-Timing-Dependent Plasticity (STDP) provides a biologically grounded learning rule for spiking neural networks (SNNs), but its reliance on precise spike timing and pairwise updates limits fast learning of weights. W…

Image Classification

Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus

2026-08-12 · Zunhai Su, Bohan Sun, Xialie Zhuang, Shuibai Zhang 외 hf

We present the first systematic study of Massive activations (MAs) in layer-interleaved HLA LLMs and uncover two architecture-aligned morphologies: MAs consistently spike immediately before full attention layers, forming…