paper-with-me

Papers

Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processors

2023-03-14 · Uğurcan Çakal, Maryada, Chenxi Wu, Ilkay Ulusoy, Dylan R. Muir

Mixed-signal neuromorphic processors provide extremely low-power operation for edge inference workloads, taking advantage of sparse asynchronous computation within Spiking Neural Networks (SNNs). However, deploying robust applications to these devices is complicated by limited controllability over analog hardware parameters, as well as unintended parameter and dynamical variations of analog circuits due to fabrication non-idealities. Here we demonstrate a novel methodology for ofDine training and deployment of spiking neural networks (SNNs) to the mixed-signal neuromorphic processor DYNAP-SE2. The methodology utilizes gradient-based training using a differentiable simulation of the mixed-signal device, coupled with an unsupervised weight quantization method to optimize the network's parameters. Parameter noise injection during training provides robustness to the effects of quantization and device mismatch, making the method a promising candidate for real-world applications under hardware constraints and non-idealities. This work extends Rockpool, an open-source deep-learning library for SNNs, with support for accurate simulation of mixed-signal SNN dynamics. Our approach simplifies the development and deployment process for the neuromorphic community, making mixed-signal neuromorphic processors more accessible to researchers and developers.

📄 PDF Abstract BibTeX arXiv:2303.12167

Code (1)

synsense/rockpool 공식 구현 jax

Tasks

Quantization

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

Multiplexed gradient descent: Fast online training of modern datasets on hardware neural networks without backpropagation

2023-03-05 · Adam N. McCaughan, Bakhrom G. Oripov, Natesh Ganesh, Sae Woo Nam 외

We present multiplexed gradient descent (MGD), a gradient descent framework designed to easily train analog or digital neural networks in hardware. MGD utilizes zero-order optimization techniques for online training of h…

GPU

Genetic Motifs as a Blueprint for Mismatch-Tolerant Neuromorphic Computing

2024-10-25 · Tommaso Boccato, Dmitrii Zendrikov, Nicola Toschi, Giacomo Indiveri

Mixed-signal implementations of SNNs offer a promising solution to edge computing applications that require low-power and compact embedded processing systems. However, device mismatch in the analog circuits of these neur…

Edge-computing

Learning in Log-Domain: Subthreshold Analog AI Accelerator Based on Stochastic Gradient Descent

2025-01-22 · Momen K Tageldeen, Yacine Belgaid, Vivek Mohan, Zhou Wang 외

The rapid proliferation of AI models, coupled with growing demand for edge deployment, necessitates the development of AI hardware that is both high-performance and energy-efficient. In this paper, we propose a novel ana…

L2 Regularization

Energy-convergence trade off for the training of neural networks on bio-inspired hardware

2025-09-10 · Nikhil Garg, Paul Uriarte Vicandi, Yanming Zhang, Alexandre Baigol 외 arxiv

The increasing deployment of wearable sensors and implantable devices is shifting AI processing demands to the extreme edge, necessitating ultra-low power for continuous operation. Inspired by the brain, emerging memrist…

Gradient-based Automatic Mixed Precision Quantization for Neural Networks On-Chip

2024-05-01 · Chang Sun, Thea K. Årrestad, Vladimir Loncar, Jennifer Ngadiuba 외

Model size and inference speed at deployment time, are major challenges in many deep learning applications. A promising strategy to overcome these challenges is quantization. However, a straightforward uniform quantizati…

Jet TaggingQuantization