Active filtering: a predictive function of recurrent circuits of sensory cortex
Our brains encode many features of the sensory world into memories: we can sing along with songs we have heard before, interpret spoken and written language composed of words we have learned, and recognize faces and objects. Where are these memories stored? Each area of the cerebral cortex has a huge number of local, recurrent, excitatory-excitatory synapses, as many as 500 million per cubic millimeter. Here I review evidence that cortical recurrent connectivity in sensory cortex is a substrate for sensory memories. Evidence suggests that the local recurrent network encodes the structure of natural sensory input, and that it does so via active filtering, transforming network inputs to boost or select those associated with natural sensation. This is a form of predictive processing, in which the cortical recurrent network selectively amplifies some input patterns and attenuates others, and a form of memory.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Cortical microcircuits as gated-recurrent neural networks
Cortical circuits exhibit intricate recurrent architectures that are remarkably similar across different brain areas. Such stereotyped structure suggests the existence of common computational principles. However, such pr…
image-classificationImage ClassificationLanguage ModellingSequential Image ClassificationRecurrent networks improve neural response prediction and provide insights into underlying cortical circuits
Feedforward CNN models have proven themselves in recent years as state-of-the-art models for predicting single-neuron responses to natural images in early visual cortical neurons. In this paper, we extend these models wi…
Recurrent Neural Network Training with Convex Loss and Regularization Functions by Extended Kalman Filtering
This paper investigates the use of extended Kalman filtering to train recurrent neural networks with rather general convex loss functions and regularization terms on the network parameters, including $\ell_1$-regularizat…
Model Predictive ControlRecurrent Graph Neural Networks and Arithmetic Circuits
We characterise the computational power of recurrent graph neural networks (GNNs) in terms of arithmetic circuits over the real numbers. Our networks are not restricted to aggregate-combine GNNs or other particular types…
Pruning for Feature-Preserving Circuits in CNNs
Deep convolutional neural networks are a powerful model class for a range of computer vision problems, but it is difficult to interpret the image filtering process they implement, given their sheer size. In this work, we…
Network Pruning