paper-with-me

Papers

Learning by Stimulation Avoidance: A Principle to Control Spiking Neural Networks Dynamics

2016-09-25 · Lana Sinapayen, Atsushi Masumori, Takashi Ikegami

Learning based on networks of real neurons, and by extension biologically inspired models of neural networks, has yet to find general learning rules leading to widespread applications. In this paper, we argue for the existence of a principle allowing to steer the dynamics of a biologically inspired neural network. Using carefully timed external stimulation, the network can be driven towards a desired dynamical state. We term this principle "Learning by Stimulation Avoidance" (LSA). We demonstrate through simulation that the minimal sufficient conditions leading to LSA in artificial networks are also sufficient to reproduce learning results similar to those obtained in biological neurons by Shahaf and Marom [1]. We examine the mechanism's basic dynamics in a reduced network, and demonstrate how it scales up to a network of 100 neurons. We show that LSA has a higher explanatory power than existing hypotheses about the response of biological neural networks to external simulation, and can be used as a learning rule for an embodied application: learning of wall avoidance by a simulated robot. The surge in popularity of artificial neural networks is mostly directed to disembodied models of neurons with biologically irrelevant dynamics: to the authors' knowledge, this is the first work demonstrating sensory-motor learning with random spiking networks through pure Hebbian learning.

📄 PDF Abstract BibTeX arXiv:1609.07706

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Predictive Coding as Stimulus Avoidance in Spiking Neural Networks

2019-11-21 · Atsushi Masumori, Lana Sinapayen, Takashi Ikegami

Predictive coding can be regarded as a function which reduces the error between an input signal and a top-down prediction. If reducing the error is equivalent to reducing the influence of stimuli from the environment, pr…

PredictionTemporal Sequences

Neural Autopoiesis: Organizing Self-Boundary by Stimulus Avoidance in Biological and Artificial Neural Networks

2020-01-27 · Atsushi Masumori, Lana Sinapayen, Norihiro Maruyama, Takeshi Mita 외

Living organisms must actively maintain themselves in order to continue existing. Autopoiesis is a key concept in the study of living organisms, where the boundaries of the organism is not static by dynamically regulated…

A new perspective on brain stimulation interventions: Optimal stochastic tracking control of brain network dynamics

2025-01-15 · Kangli Dong, Siya Chen, Ying Dan, Lu Zhang 외

Network control theory (NCT) has recently been utilized in neuroscience to facilitate our understanding of brain stimulation effects. A particularly useful branch of NCT is optimal control, which focuses on applying theo…

Learning Control Policies of Hodgkin-Huxley Neuronal Dynamics

2023-11-13 · Malvern Madondo, Deepanshu Verma, Lars Ruthotto, Nicholas Au Yong

We present a neural network approach for closed-loop deep brain stimulation (DBS). We cast the problem of finding an optimal neurostimulation strategy as a control problem. In this setting, control policies aim to optimi…

Data-Driven Predictive Modeling of Neuronal Dynamics using Long Short-Term Memory

2019-08-11 · Benjamin Plaster, Gautam Kumar

Modeling brain dynamics to better understand and control complex behaviors underlying various cognitive brain functions are of interests to engineers, mathematicians, and physicists from the last several decades. With a …