paper-with-me

홈 › Papers

Nonlinear computations in spiking neural networks through multiplicative synapses

2020-09-08 · Michele Nardin, James W Phillips, William F. Podlaski, Sander W Keemink

The brain efficiently performs nonlinear computations through its intricate networks of spiking neurons, but how this is done remains elusive. While nonlinear computations can be implemented successfully in spiking neural networks, this requires supervised training and the resulting connectivity can be hard to interpret. In contrast, the required connectivity for any computation in the form of a linear dynamical system can be directly derived and understood with the spike coding network (SCN) framework. These networks also have biologically realistic activity patterns and are highly robust to cell death. Here we extend the SCN framework to directly implement any polynomial dynamical system, without the need for training. This results in networks requiring a mix of synapse types (fast, slow, and multiplicative), which we term multiplicative spike coding networks (mSCNs). Using mSCNs, we demonstrate how to directly derive the required connectivity for several nonlinear dynamical systems. We also show how to carry out higher-order polynomials with coupled networks that use only pair-wise multiplicative synapses, and provide expected numbers of connections for each synapse type. Overall, our work demonstrates a novel method for implementing nonlinear computations in spiking neural networks, while keeping the attractive features of standard SCNs (robustness, realistic activity patterns, and interpretable connectivity). Finally, we discuss the biological plausibility of our approach, and how the high accuracy and robustness of the approach may be of interest for neuromorphic computing.

📄 PDF Abstract BibTeX arXiv:2009.03857

Code (1)

michnard/mult_synapses 공식 구현

Methods 이 논문이 사용한 방법론

SCN Self-Cure Network, or SCN, is a method for suppressing uncertainties for large-scale facial expression recognition, prventing deep networks from overfitting uncertain…

Similar Papers 제목 키워드 기반

Constructing precisely computing networks with biophysical spiking neurons

2015-07-16

While spike timing has been shown to carry detailed stimulus information at the sensory periphery, its possible role in network computation is less clear. Most models of computation by neural networks are based on popula…

Visual representations derived from multiplicative interactions

2020-10-09 · NeurIPS Workshop SVRHM 2020 12 · Eric Elmoznino, Michael Bonner

Biological sensory systems appear to rely on canonical nonlinear computations that can be readily adapted to a broad range of representational objectives. Here we test the hypothesis that one such computation—multiplicat…

Spike-based primitives for graph algorithms

2019-03-25 · Kathleen E. Hamilton, Tiffany M. Mintz, Catherine D. Schuman

In this paper we consider graph algorithms and graphical analysis as a new application for neuromorphic computing platforms. We demonstrate how the nonlinear dynamics of spiking neurons can be used to implement low-level…

Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses

2019-05-28 · S. R. Nandakumar, Irem Boybat, Manuel Le Gallo, Evangelos Eleftheriou 외

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to…

Plug-and-Play Spiking Operators: Breaking the Nonlinearity Bottleneck in Spiking Transformers

2026-05-19 · Xinzhe Yuan, Xiang Peng, Bin Gu, Huan Xiong arxiv

ANN-to-SNN conversion offers a practical, training-free route to spiking large language models. However, current pipelines primarily focus on spike-driven realizations for Transformer linear-algebra operations, while pro…