paper-with-me

홈 › Papers

Neuromorphic Data Augmentation for Training Spiking Neural Networks

2022-03-11 · Yuhang Li, Youngeun Kim, Hyoungseob Park, Tamar Geller, Priyadarshini Panda

Developing neuromorphic intelligence on event-based datasets with Spiking Neural Networks (SNNs) has recently attracted much research attention. However, the limited size of event-based datasets makes SNNs prone to overfitting and unstable convergence. This issue remains unexplored by previous academic works. In an effort to minimize this generalization gap, we propose Neuromorphic Data Augmentation (NDA), a family of geometric augmentations specifically designed for event-based datasets with the goal of significantly stabilizing the SNN training and reducing the generalization gap between training and test performance. The proposed method is simple and compatible with existing SNN training pipelines. Using the proposed augmentation, for the first time, we demonstrate the feasibility of unsupervised contrastive learning for SNNs. We conduct comprehensive experiments on prevailing neuromorphic vision benchmarks and show that NDA yields substantial improvements over previous state-of-the-art results. For example, the NDA-based SNN achieves accuracy gain on CIFAR10-DVS and N-Caltech 101 by 10.1% and 13.7%, respectively. Code is available on GitHub https://github.com/Intelligent-Computing-Lab-Yale/NDA_SNN

📄 PDF Abstract BibTeX arXiv:2203.06145

Code (1)

intelligent-computing-lab-yale/nda_snn 공식 구현 pytorch

Tasks

Contrastive LearningData AugmentationEvent data classification

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Training Robust Spiking Neural Networks on Neuromorphic Data with Spatiotemporal Fragments

2022-07-24 · Haibo Shen, Yihao Luo, Xiang Cao, Liangqi Zhang 외

Neuromorphic vision sensors (event cameras) are inherently suitable for spiking neural networks (SNNs) and provide novel neuromorphic vision data for this biomimetic model. Due to the spatiotemporal characteristics, nove…

Data Augmentation

Loss shaping enhances exact gradient learning with Eventprop in spiking neural networks

2022-12-02 · Thomas Nowotny, James P. Turner, James C. Knight

Event-based machine learning promises more energy-efficient AI on future neuromorphic hardware. Here, we investigate how the recently discovered Eventprop algorithm for gradient descent on exact gradients in spiking neur…

GPU

Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Network

2024-01-02 · Yongqi Ding, Lin Zuo, Mengmeng Jing, Pei He 외

Neuromorphic object recognition with spiking neural networks (SNNs) is the cornerstone of low-power neuromorphic computing. However, existing SNNs suffer from significant latency, utilizing 10 to 40 timesteps or more, to…

Data AugmentationEvent data classificationObject Recognition

SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence

2023-10-25 · Wei Fang, Yanqi Chen, Jianhao Ding, Zhaofei Yu 외

Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties. As the emerging spiking deep learning parad…

Code Generation

Spiking Linear Dynamical Systems on Neuromorphic Hardware for Low-Power Brain-Machine Interfaces

2018-05-22 · David G. Clark, Jesse A. Livezey, Edward F. Chang, Kristofer E. Bouchard

Neuromorphic architectures achieve low-power operation by using many simple spiking neurons in lieu of traditional hardware. Here, we develop methods for precise linear computations in spiking neural networks and use the…