paper-with-me

홈 › Papers

Learning to learn online with neuromodulated synaptic plasticity in spiking neural networks

2022-06-25 · Samuel Schmidgall, Joe Hays

We propose that in order to harness our understanding of neuroscience toward machine learning, we must first have powerful tools for training brain-like models of learning. Although substantial progress has been made toward understanding the dynamics of learning in the brain, neuroscience-derived models of learning have yet to demonstrate the same performance capabilities as methods in deep learning such as gradient descent. Inspired by the successes of machine learning using gradient descent, we demonstrate that models of neuromodulated synaptic plasticity from neuroscience can be trained in Spiking Neural Networks (SNNs) with a framework of learning to learn through gradient descent to address challenging online learning problems. This framework opens a new path toward developing neuroscience inspired online learning algorithms.

📄 PDF Abstract BibTeX arXiv:2206.12520

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

SpikePropamine: Differentiable Plasticity in Spiking Neural Networks

2021-06-04 · Samuel Schmidgall, Julia Ashkanazy, Wallace Lawson, Joe Hays

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning fo…

Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticity

2020-02-24 · ICLR 2019 5 · Thomas Miconi, Aditya Rawal, Jeff Clune, Kenneth O. Stanley

The impressive lifelong learning in animal brains is primarily enabled by plastic changes in synaptic connectivity. Importantly, these changes are not passive, but are actively controlled by neuromodulation, which is its…

Language ModelingLanguage ModellingLifelong learningreinforcement-learning+2

A Spiking Neuron Synaptic Plasticity Model Optimized for Unsupervised Learning

2021-11-12 · Mikhail Kiselev

Spiking neural networks (SNN) are considered as a perspective basis for performing all kinds of learning tasks - unsupervised, supervised and reinforcement learning. Learning in SNN is implemented through synaptic plasti…

Diversity

Effects of Introducing Synaptic Scaling on Spiking Neural Network Learning

2026-01-16 · Shinnosuke Touda, Hirotsugu Okuno arxiv

Spiking neural networks (SNNs) employing unsupervised learning methods inspired by neural plasticity are expected to be a new framework for artificial intelligence. In this study, we investigated the effect of multiple t…

Synaptic Sampling: A Bayesian Approach to Neural Network Plasticity and Rewiring

2015-12-01 · NeurIPS 2015 12 · David Kappel, Stefan Habenschuss, Robert Legenstein, Wolfgang Maass

We reexamine in this article the conceptual and mathematical framework for understanding the organization of plasticity in spiking neural networks. We propose that inherent stochasticity enables synaptic plasticity to ca…