paper-with-me

Papers

When Spiking neural networks meet temporal attention image decoding and adaptive spiking neuron

2024-06-05 · Xuerui Qiu, Zheng Luan, Zhaorui Wang, Rui-Jie Zhu

Spiking Neural Networks (SNNs) are capable of encoding and processing temporal information in a biologically plausible way. However, most existing SNN-based methods for image tasks do not fully exploit this feature. Moreover, they often overlook the role of adaptive threshold in spiking neurons, which can enhance their dynamic behavior and learning ability. To address these issues, we propose a novel method for image decoding based on temporal attention (TAID) and an adaptive Leaky-Integrate-and-Fire (ALIF) neuron model. Our method leverages the temporal information of SNN outputs to generate high-quality images that surpass the state-of-the-art (SOTA) in terms of Inception score, Fr\'echet Inception Distance, and Fr\'echet Autoencoder Distance. Furthermore, our ALIF neuron model achieves remarkable classification accuracy on MNIST (99.78\%) and CIFAR-10 (93.89\%) datasets, demonstrating the effectiveness of learning adaptive thresholds for spiking neurons. The code is available at https://github.com/bollossom/ICLR_TINY_SNN.

📄 PDF Abstract BibTeX arXiv:2406.03046

Code (1)

bollossom/iclr_tiny_snn 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SNN Spiking Neural Networks (SNNs) are a class of artificial neural networks inspired by the structure and functioning of the brain's neural networks. Unlike traditional…

Similar Papers 제목 키워드 기반

Spikformer: When Spiking Neural Network Meets Transformer

2022-09-29 · Zhaokun Zhou, Yuesheng Zhu, Chao He, YaoWei Wang 외

We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the self-attention mechanism. The former offers an energy-efficient and event-driven paradigm for deep learning, while the latter ha…

image-classificationImage Classification

DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention

2024-09-20 · Boxun Xu, Hejia Geng, Yuxuan Yin, Peng Li

Vision Transformers (ViT) are current high-performance models of choice for various vision applications. Recent developments have given rise to biologically inspired spiking transformers that thrive in ultra-low power op…

Denoising

SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition

2024-10-22 · Jiaqi Chen, Yan Yang, Shizhuo Deng, Da Teng 외

Human action recognition (HAR) plays a key role in various applications such as video analysis, surveillance, autonomous driving, robotics, and healthcare. Most HAR algorithms are developed from RGB images, which capture…

Action RecognitionAutonomous DrivingMambaTemporal Action Localization

DISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention

2023-11-15 · Boxun Xu, Hejia Geng, Yuxuan Yin, Peng Li

Among the array of neural network architectures, the Vision Transformer (ViT) stands out as a prominent choice, acclaimed for its exceptional expressiveness and consistent high performance in various vision applications.…

Denoising

S3TC: Spiking Separated Spatial and Temporal Convolutions with Unsupervised STDP-based Learning for Action Recognition

2023-09-22 · Mireille El-Assal, Pierre Tirilly, Ioan Marius Bilasco

Video analysis is a major computer vision task that has received a lot of attention in recent years. The current state-of-the-art performance for video analysis is achieved with Deep Neural Networks (DNNs) that have high…

Action Recognition