paper-with-me

홈 › Papers

aSTDP: A More Biologically Plausible Learning

2022-05-22 · Shiyuan Li

Spike-timing dependent plasticity in biological neural networks has been proven to be important during biological learning process. On the other hand, artificial neural networks use a different way to learn, such as Back-Propagation or Contrastive Hebbian Learning. In this work we introduce approximate STDP, a new neural networks learning framework more similar to the biological learning process. It uses only STDP rules for supervised and unsupervised learning, every neuron distributed learn patterns and don' t need a global loss or other supervised information. We also use a numerical way to approximate the derivatives of each neuron in order to better use SDTP learning and use the derivatives to set a target for neurons to accelerate training and testing process. The framework can make predictions or generate patterns in one model without additional configuration. Finally, we verified our framework on MNIST dataset for classification and generation tasks.

📄 PDF Abstract BibTeX arXiv:2206.14137

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules

2022-06-02 · Yuhan Helena Liu, Arna Ghosh, Blake A. Richards, Eric Shea-Brown 외

To unveil how the brain learns, ongoing work seeks biologically-plausible approximations of gradient descent algorithms for training recurrent neural networks (RNNs). Yet, beyond task accuracy, it is unclear if such lear…

Learning Theory

Counter-Current Learning: A Biologically Plausible Dual Network Approach for Deep Learning

2024-09-30 · Chia-Hsiang Kao, Bharath Hariharan

Despite its widespread use in neural networks, error backpropagation has faced criticism for its lack of biological plausibility, suffering from issues such as the backward locking problem and the weight transport proble…

Representation Learning

Can Biologically Plausible Temporal Credit Assignment Rules Match BPTT for Neural Similarity? E-prop as an Example

2025-06-07 · Yuhan Helena Liu, Guangyu Robert Yang, Christopher J. Cueva

Understanding how the brain learns may be informed by studying biologically plausible learning rules. These rules, often approximating gradient descent learning to respect biological constraints such as locality, must me…

Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

2020-10-09 · Tielin Zhang, Shuncheng Jia, Xiang Cheng, Bo Xu

Spiking Neural Networks (SNNs) contain more biologically realistic structures and biologically-inspired learning principles than those in standard Artificial Neural Networks (ANNs). SNNs are considered the third generati…

Streaming Normalization: Towards Simpler and More Biologically-plausible Normalizations for Online and Recurrent Learning

2016-10-19 · Qianli Liao, Kenji Kawaguchi, Tomaso Poggio

We systematically explored a spectrum of normalization algorithms related to Batch Normalization (BN) and propose a generalized formulation that simultaneously solves two major limitations of BN: (1) online learning and …

GPU