paper-with-me

홈 › Papers

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

2023-03-31 · Wenxuan Pan, Feifei Zhao, Yi Zeng, Bing Han

The architecture design and multi-scale learning principles of the human brain that evolved over hundreds of millions of years are crucial to realizing human-like intelligence. Spiking Neural Network (SNN) based Liquid State Machine (LSM) serves as a suitable architecture to study brain-inspired intelligence because of its brain-inspired structure and the potential for integrating multiple biological principles. Existing researches on LSM focus on different certain perspectives, including high-dimensional encoding or optimization of the liquid layer, network architecture search, and application to hardware devices. There is still a lack of in-depth inspiration from the learning and structural evolution mechanism of the brain. Considering these limitations, this paper presents a novel LSM learning model that integrates adaptive structural evolution and multi-scale biological learning rules. For structural evolution, an adaptive evolvable LSM model is developed to optimize the neural architecture design of liquid layer with separation property. For brain-inspired learning of LSM, we propose a dopamine-modulated Bienenstock-Cooper-Munros (DA-BCM) method that incorporates global long-term dopamine regulation and local trace-based BCM synaptic plasticity. Comparative experimental results on different decision-making tasks show that introducing structural evolution of the liquid layer, and the DA-BCM regulation of the liquid layer and the readout layer could improve the decision-making ability of LSM and flexibly adapt to rule reversal. This work is committed to exploring how evolution can help to design more appropriate network architectures and how multi-scale neuroplasticity principles coordinated to enable the optimization and learning of LSMs for relatively complex decision-making tasks.

📄 PDF Abstract BibTeX arXiv:2304.01015

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Sensitivity Analysis for additive STDP rule

2015-02-28 · Subhajit Sengupta, Karthik S. Gurumoorthy, Arunava Banerjee

Spike Timing Dependent Plasticity (STDP) is a Hebbian like synaptic learning rule. The basis of STDP has strong experimental evidences and it depends on precise input and output spike timings. In this paper we show that …

Sensitivity

Synaptic Dynamics Realize First-order Adaptive Learning and Weight Symmetry

2022-12-01 · Yukun Yang, Peng Li

Gradient-based first-order adaptive optimization methods such as the Adam optimizer are prevalent in training artificial networks, achieving the state-of-the-art results. This work attempts to answer the question whether…

A biologically plausible neural network for multi-channel Canonical Correlation Analysis

2020-10-01 · David Lipshutz, Yanis Bahroun, Siavash Golkar, Anirvan M. Sengupta 외

Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement Canonica…

A novel plasticity rule can explain the development of sensorimotor intelligence

2015-05-04 · Ralf Der, Georg Martius

Grounding autonomous behavior in the nervous system is a fundamental challenge for neuroscience. In particular, the self-organized behavioral development provides more questions than answers. Are there special functional…

Self-Learning

Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

2020-10-09 · Tielin Zhang, Shuncheng Jia, Xiang Cheng, Bo Xu

Spiking Neural Networks (SNNs) contain more biologically realistic structures and biologically-inspired learning principles than those in standard Artificial Neural Networks (ANNs). SNNs are considered the third generati…