paper-with-me

홈 › Papers

Learning to combine top-down context and feed-forward representations under ambiguity with apical and basal dendrites

2023-12-09 · Nizar Islah, Guillaume Etter, Mashbayar Tugsbayar, Tugce Gurbuz, Blake Richards, Eilif Muller

One of the hallmark features of neocortical anatomy is the presence of extensive top-down projections into primary sensory areas, with many impinging on the distal apical dendrites of pyramidal neurons. While it is known that they exert a modulatory effect, altering the gain of responses, their functional role remains an active area of research. It is hypothesized that these top-down projections carry contextual information that can help animals to resolve ambiguities in sensory data. One proposed mechanism of contextual integration is a non-linear integration of distinct input streams at apical and basal dendrites of pyramidal neurons. Computationally, however, it is yet to be demonstrated how such an architecture could leverage distinct compartments for flexible contextual integration and sensory processing when both sensory and context signals can be unreliable. Here, we implement an augmented deep neural network with distinct apical and basal compartments that integrates a) contextual information from top-down projections to apical compartments, and b) sensory representations driven by bottom-up projections to basal compartments, via a biophysically inspired rule. In addition, we develop a new multi-scenario contextual integration task using a generative image modeling approach. In addition to generalizing previous contextual integration tasks, it better captures the diversity of scenarios where neither contextual nor sensory information are fully reliable. To solve this task, this model successfully learns to select among integration strategies. We find that our model outperforms those without the "apical prior" when contextual information contradicts sensory input. Altogether, this suggests that the apical prior and biophysically inspired integration rule could be key components necessary for handling the ambiguities that animals encounter in the diverse contexts of the real world.

📄 PDF Abstract BibTeX arXiv:2312.05484

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyTemporal Sequences

Similar Papers 제목 키워드 기반

Neural Function Modules with Sparse Arguments: A Dynamic Approach to Integrating Information across Layers

2020-10-15 · Alex Lamb, Anirudh Goyal, Agnieszka Słowik, Michael Mozer 외

Feed-forward neural networks consist of a sequence of layers, in which each layer performs some processing on the information from the previous layer. A downside to this approach is that each layer (or module, as multipl…

Domain Generalization

Recurrent Feedback Improves Feedforward Representations in Deep Neural Networks

2019-12-22 · Siming Yan, Xuyang Fang, Bowen Xiao, Harold Rockwell 외

The abundant recurrent horizontal and feedback connections in the primate visual cortex are thought to play an important role in bringing global and semantic contextual information to early visual areas during perceptual…

Beyond Skip Connections: Top-Down Modulation for Object Detection

2016-12-20 · Abhinav Shrivastava, Rahul Sukthankar, Jitendra Malik, Abhinav Gupta

In recent years, we have seen tremendous progress in the field of object detection. Most of the recent improvements have been achieved by targeting deeper feedforward networks. However, many hard object categories such a…

Objectobject-detectionObject Detection

Contextual Feedback Loops: Amplifying Deep Reasoning with Iterative Top-Down Feedback

2024-12-23 · Jacob Fein-Ashley, Rajgopal Kannan, Viktor Prasanna

Conventional deep networks rely on one-way backpropagation that overlooks reconciling high-level predictions with lower-level representations. We propose \emph{Contextual Feedback Loops} (CFLs), a lightweight mechanism t…

SST-2

Contextual Recurrent Convolutional Model for Robust Visual Learning

2019-05-01 · ICLR 2019 5 · Siming Yan*, Bowen Xiao*, Yimeng Zhang, Tai Sing Lee

Feedforward convolutional neural network has achieved a great success in many computer vision tasks. While it validly imitates the hierarchical structure of biological visual system, it still lacks one essential architec…

Fine-Grained Image ClassificationGeneral Classificationimage-classificationImage Classification+2