paper-with-me

홈 › Papers

Modeling Bottom-Up and Top-Down Attention with a Neurodynamic Model of V1

2019-11-18

Previous studies suggested that lateral interactions of V1 cells are responsible, among other visual effects, of bottom-up visual attention (alternatively named visual salience or saliency). Our objective is to mimic these connections with a neurodynamic network of firing-rate neurons in order to predict visual attention. Early visual subcortical processes (i.e. retinal and thalamic) are functionally simulated. An implementation of the cortical magnification function is included to define the retinotopical projections towards V1, processing neuronal activity for each distinct view during scene observation. Novel computational definitions of top-down inhibition (in terms of inhibition of return and selection mechanisms), are also proposed to predict attention in Free-Viewing and Visual Search tasks. Results show that our model outpeforms other biologically-inpired models of saliency prediction while predicting visual saccade sequences with the same model. We also show how temporal and spatial characteristics of inhibition of return can improve prediction of saccades, as well as how distinct search strategies (in terms of feature-selective or category-specific inhibition) can predict attention at distinct image contexts.

📄 PDF Abstract BibTeX arXiv:1904.02741

Code (1)

dberga/NSWAM 공식 구현

Tasks

Saliency Prediction

Similar Papers 제목 키워드 기반

Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules

2020-06-30 · ICML 2020 1 · Sarthak Mittal, Alex Lamb, Anirudh Goyal, Vikram Voleti 외

Robust perception relies on both bottom-up and top-down signals. Bottom-up signals consist of what's directly observed through sensation. Top-down signals consist of beliefs and expectations based on past experience and …

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+3

Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detection

2022-07-16 · Jingjia Huang, Baixiang Yang

Human Object Interaction (HOI) detection is a challenging task that requires to distinguish the interaction between a human-object pair. Attention based relation parsing is a popular and effective strategy utilized in HO…

DecoderHuman-Object Interaction DetectionRelation

Unifying Top-down and Bottom-up for Recurrent Visual Attention

2021-09-29 · Gang Chen

The idea of using the recurrent neural network for visual attention has gained popularity in computer vision community. Although the recurrent visual attention model (RAM) leverages the glimpses with more large patch siz…

Q-Learning

SVAM: Saliency-guided Visual Attention Modeling by Autonomous Underwater Robots

2020-11-12 · Md Jahidul Islam, Ruobing Wang, Junaed Sattar

This paper presents a holistic approach to saliency-guided visual attention modeling (SVAM) for use by autonomous underwater robots. Our proposed model, named SVAM-Net, integrates deep visual features at various scales a…

object-detectionObject DetectionSaliency PredictionSalient Object Detection

Image Captioning with Integrated Bottom-Up and Multi-level Residual Top-Down Attention for Game Scene Understanding

2019-06-16 · Jian Zheng, Sudha Krishnamurthy, Ruxin Chen, Min-Hung Chen 외

Image captioning has attracted considerable attention in recent years. However, little work has been done for game image captioning which has some unique characteristics and requirements. In this work we propose a novel …

Caption GenerationImage CaptioningScene Understanding