paper-with-me

Papers

Dendritic cortical microcircuits approximate the backpropagation algorithm

2018-10-26 · NeurIPS 2018 12 · João Sacramento, Rui Ponte Costa, Yoshua Bengio, Walter Senn

Deep learning has seen remarkable developments over the last years, many of them inspired by neuroscience. However, the main learning mechanism behind these advances - error backpropagation - appears to be at odds with neurobiology. Here, we introduce a multilayer neuronal network model with simplified dendritic compartments in which error-driven synaptic plasticity adapts the network towards a global desired output. In contrast to previous work our model does not require separate phases and synaptic learning is driven by local dendritic prediction errors continuously in time. Such errors originate at apical dendrites and occur due to a mismatch between predictive input from lateral interneurons and activity from actual top-down feedback. Through the use of simple dendritic compartments and different cell-types our model can represent both error and normal activity within a pyramidal neuron. We demonstrate the learning capabilities of the model in regression and classification tasks, and show analytically that it approximates the error backpropagation algorithm. Moreover, our framework is consistent with recent observations of learning between brain areas and the architecture of cortical microcircuits. Overall, we introduce a novel view of learning on dendritic cortical circuits and on how the brain may solve the long-standing synaptic credit assignment problem.

📄 PDF Abstract BibTeX arXiv:1810.11393

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Dendritic error backpropagation in deep cortical microcircuits

2017-12-30 · João Sacramento, Rui Ponte Costa, Yoshua Bengio, Walter Senn

Animal behaviour depends on learning to associate sensory stimuli with the desired motor command. Understanding how the brain orchestrates the necessary synaptic modifications across different brain areas has remained a …

Denoising

A biologically plausible neural network for local supervision in cortical microcircuits

2020-11-30 · Siavash Golkar, David Lipshutz, Yanis Bahroun, Anirvan M. Sengupta 외

The backpropagation algorithm is an invaluable tool for training artificial neural networks; however, because of a weight sharing requirement, it does not provide a plausible model of brain function. Here, in the context…

A biologically plausible neural network for multi-channel Canonical Correlation Analysis

2020-10-01 · David Lipshutz, Yanis Bahroun, Siavash Golkar, Anirvan M. Sengupta 외

Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement Canonica…

Relaxing the Constraints on Predictive Coding Models

2020-10-02 · Beren Millidge, Alexander Tschantz, Anil Seth, Christopher L Buckley

Predictive coding is an influential theory of cortical function which posits that the principal computation the brain performs, which underlies both perception and learning, is the minimization of prediction errors. Whil…

Variational Inference

A Computational Framework of Cortical Microcircuits Approximates Sign-concordant Random Backpropagation

2022-05-15 · Yukun Yang, Peng Li

Several recent studies attempt to address the biological implausibility of the well-known backpropagation (BP) method. While promising methods such as feedback alignment, direct feedback alignment, and their variants lik…