paper-with-me

Papers

Predictive Coding: a Theoretical and Experimental Review

2021-07-27 · Beren Millidge, Anil Seth, Christopher L Buckley

Predictive coding offers a potentially unifying account of cortical function -- postulating that the core function of the brain is to minimize prediction errors with respect to a generative model of the world. The theory is closely related to the Bayesian brain framework and, over the last two decades, has gained substantial influence in the fields of theoretical and cognitive neuroscience. A large body of research has arisen based on both empirically testing improved and extended theoretical and mathematical models of predictive coding, as well as in evaluating their potential biological plausibility for implementation in the brain and the concrete neurophysiological and psychological predictions made by the theory. Despite this enduring popularity, however, no comprehensive review of predictive coding theory, and especially of recent developments in this field, exists. Here, we provide a comprehensive review both of the core mathematical structure and logic of predictive coding, thus complementing recent tutorials in the literature. We also review a wide range of classic and recent work within the framework, ranging from the neurobiologically realistic microcircuits that could implement predictive coding, to the close relationship between predictive coding and the widely-used backpropagation of error algorithm, as well as surveying the close relationships between predictive coding and modern machine learning techniques.

📄 PDF Abstract BibTeX arXiv:2107.12979

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?

2022-02-18 · Beren Millidge, Tommaso Salvatori, Yuhang Song, Rafal Bogacz 외

The backpropagation of error algorithm used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backward updates and non-local computations, which make it…

Deep Learning

Predictive Coding with Spiking Neural Networks: a Survey

2024-09-09 · Antony W. N'dri, William Gebhardt, Céline Teulière, Fleur Zeldenrust 외

In this article, we review a class of neuro-mimetic computational models that we place under the label of spiking predictive coding. Specifically, we review the general framework of predictive processing in the context o…

Edge-computingPredictionSurvey

Predictive Coding, Variational Autoencoders, and Biological Connections

2020-11-15 · NeurIPS Workshop Neuro_AI 2019 12 · Joseph Marino

This paper reviews predictive coding, from theoretical neuroscience, and variational autoencoders, from machine learning, identifying the common origin and mathematical framework underlying both areas. As each area is pr…

BIG-bench Machine Learning

Explainable Text Classification in Legal Document Review A Case Study of Explainable Predictive Coding

2019-04-03 · Rishi Chhatwal, Peter Gronvall, Nathaniel Huber-Fliflet, Robert Keeling 외

In today's legal environment, lawsuits and regulatory investigations require companies to embark upon increasingly intensive data-focused engagements to identify, collect and analyze large quantities of data. When docume…

Document ClassificationGeneral Classificationtext-classificationText Classification

Hierarchical Predictive Coding Models in a Deep-Learning Framework

2020-05-07 · Matin Hosseini, Anthony Maida

Bayesian predictive coding is a putative neuromorphic method for acquiring higher-level neural representations to account for sensory input. Although originating in the neuroscience community, there are also efforts in t…

Deep Learning