paper-with-me

홈 › Papers

Connectivity-Inspired Network for Context-Aware Recognition

2024-09-06 · Gianluca Carloni, Sara Colantonio

The aim of this paper is threefold. We inform the AI practitioner about the human visual system with an extensive literature review; we propose a novel biologically motivated neural network for image classification; and, finally, we present a new plug-and-play module to model context awareness. We focus on the effect of incorporating circuit motifs found in biological brains to address visual recognition. Our convolutional architecture is inspired by the connectivity of human cortical and subcortical streams, and we implement bottom-up and top-down modulations that mimic the extensive afferent and efferent connections between visual and cognitive areas. Our Contextual Attention Block is simple and effective and can be integrated with any feed-forward neural network. It infers weights that multiply the feature maps according to their causal influence on the scene, modeling the co-occurrence of different objects in the image. We place our module at different bottlenecks to infuse a hierarchical context awareness into the model. We validated our proposals through image classification experiments on benchmark data and found a consistent improvement in performance and the robustness of the produced explanations via class activation. Our code is available at https://github.com/gianlucarloni/CoCoReco.

📄 PDF Abstract BibTeX arXiv:2409.04360

Code (1)

gianlucarloni/cocoreco 공식 구현 pytorch

Tasks

Biologically-plausible TrainingCausal DiscoveryFunctional Connectivityimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
CAB The Contextual Attention Block (CAB) is a new plug-and-play module to model context awareness. It is simple and effective and can be integrated with any feed-forward neural…
DCNN Diffusion-convolutional neural networks (DCNN) is a model for graph-structured data. Through the introduction of a diffusion-convolution operation, diffusion-based representations…
Causal inference Causal inference is the process of drawing a conclusion about a causal connection based on the conditions of the occurrence of an effect. The main difference between causal…

Similar Papers 제목 키워드 기반

V1Net: A computational model of cortical horizontal connections

2019-09-25 · Vijay Veerabadran, Virginia R. de Sa

The primate visual system builds robust, multi-purpose representations of the external world in order to support several diverse downstream cortical processes. Such representations are required to be invariant to the sen…

Boundary DetectionmodelObject Recognition

Connective Cognition Network for Directional Visual Commonsense Reasoning

2019-12-01 · NeurIPS 2019 12 · Aming Wu, Linchao Zhu, Yahong Han, Yi Yang

Visual commonsense reasoning (VCR) has been introduced to boost research of cognition-level visual understanding, i.e., a thorough understanding of correlated details of the scene plus an inference with related commonsen…

SentenceVisual Commonsense Reasoning

Multi-Neuron Representations of Hierarchical Concepts in Spiking Neural Networks

2024-01-09 · Nancy A. Lynch

We describe how hierarchical concepts can be represented in three types of layered neural networks. The aim is to support recognition of the concepts when partial information about the concepts is presented, and also whe…

Efficient Human Vision Inspired Action Recognition using Adaptive Spatiotemporal Sampling

2022-07-12 · Khoi-Nguyen C. Mac, Minh N. Do, Minh P. Vo

Adaptive sampling that exploits the spatiotemporal redundancy in videos is critical for always-on action recognition on wearable devices with limited computing and battery resources. The commonly used fixed sampling stra…

Action Recognition

ConnNet: A Long-Range Relation-Aware Pixel-Connectivity Network for Salient Segmentation

2018-04-20 · Michael Kampffmeyer, Nanqing Dong, Xiaodan Liang, Yu-jia Zhang 외

Salient segmentation aims to segment out attention-grabbing regions, a critical yet challenging task and the foundation of many high-level computer vision applications. It requires semantic-aware grouping of pixels into …

RelationSegmentationSemantic Segmentation