paper-with-me

홈 › Papers

Biologically Plausible Variational Policy Gradient with Spiking Recurrent Winner-Take-All Networks

2022-10-21 · Zhile Yang, Shangqi Guo, Ying Fang, Jian K. Liu

One stream of reinforcement learning research is exploring biologically plausible models and algorithms to simulate biological intelligence and fit neuromorphic hardware. Among them, reward-modulated spike-timing-dependent plasticity (R-STDP) is a recent branch with good potential in energy efficiency. However, current R-STDP methods rely on heuristic designs of local learning rules, thus requiring task-specific expert knowledge. In this paper, we consider a spiking recurrent winner-take-all network, and propose a new R-STDP method, spiking variational policy gradient (SVPG), whose local learning rules are derived from the global policy gradient and thus eliminate the need for heuristic designs. In experiments of MNIST classification and Gym InvertedPendulum, our SVPG achieves good training performance, and also presents better robustness to various kinds of noises than conventional methods.

📄 PDF Abstract BibTeX arXiv:2210.13225

Code (1)

yzlc080733/bmvc2022_svpg 공식 구현 pytorch

Tasks

AllReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Adam 설명 없음
SVPG 설명 없음

Similar Papers 제목 키워드 기반

Scaling SNNs Trained Using Equilibrium Propagation to Convolutional Architectures

2024-05-04 · Jiaqi Lin, Malyaban Bal, Abhronil Sengupta

Equilibrium Propagation (EP) is a biologically plausible local learning algorithm initially developed for convergent recurrent neural networks (RNNs), where weight updates rely solely on the connecting neuron states acro…

Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

2020-10-09 · Tielin Zhang, Shuncheng Jia, Xiang Cheng, Bo Xu

Spiking Neural Networks (SNNs) contain more biologically realistic structures and biologically-inspired learning principles than those in standard Artificial Neural Networks (ANNs). SNNs are considered the third generati…

Hybrid ANN-SNN Pipeline with Local Plasticity

2026-06-18 · Denis Larionov, Khairutin Shtanchaev, Mikhail Kiselev, Mikhail Korovin 외 arxiv

This work proposes a hybrid ANN-SNN pipeline that effectively leverages the rich embeddings of pretrained artificial neural networks (ANNs) to enable high-performance spiking neural networks (SNNs). The architecture coup…

BioGrad: Biologically Plausible Gradient-Based Learning for Spiking Neural Networks

2021-10-27 · Guangzhi Tang, Neelesh Kumar, Ioannis Polykretis, Konstantinos P. Michmizos

Spiking neural networks (SNN) are delivering energy-efficient, massively parallel, and low-latency solutions to AI problems, facilitated by the emerging neuromorphic chips. To harness these computational benefits, SNN ne…

GPU

Training Spiking Neural Networks Using Lessons From Deep Learning

2021-09-27 · Jason K. Eshraghian, Max Ward, Emre Neftci, Xinxin Wang 외

The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This…

Deep Learning