A Novel Method to Study Bottom-up Visual Saliency and its Neural Mechanism

2016-04-13 · Cheng Chen, Xilin Zhang, Yizhou Wang, Fang Fang

In this study, we propose a novel method to measure bottom-up saliency maps of natural images. In order to eliminate the influence of top-down signals, backward masking is used to make stimuli (natural images) subjectively invisible to subjects, however, the bottom-up saliency can still orient the subjects attention. To measure this orientation/attention effect, we adopt the cueing effect paradigm by deploying discrimination tasks at each location of an image, and measure the discrimination performance variation across the image as the attentional effect of the bottom-up saliency. Such attentional effects are combined to construct a final bottomup saliency map. Based on the proposed method, we introduce a new bottom-up saliency map dataset of natural images to benchmark computational models. We compare several state-of-the-art saliency models on the dataset. Moreover, the proposed paradigm is applied to investigate the neural basis of the bottom-up visual saliency map by analyzing psychophysical and fMRI experimental results. Our findings suggest that the bottom-up saliency maps of natural images are constructed in V1. It provides a strong scientific evidence to resolve the long standing dispute in neuroscience about where the bottom-up saliency map is constructed in human brain.

📄 PDF Abstract BibTeX arXiv:1604.08426

Code (0)

등록된 구현이 없습니다.

Learning to predict where to look in interactive environments using deep recurrent q-learning

2016-12-17 · Sajad Mousavi, Michael Schukat, Enda Howley, Ali Borji 외

Bottom-Up (BU) saliency models do not perform well in complex interactive environments where humans are actively engaged in tasks (e.g., sandwich making and playing the video games). In this paper, we leverage Reinforcem…

Atari Games Q-Learning reinforcement-learning Reinforcement Learning+1

DeepFeat: A Bottom Up and Top Down Saliency Model Based on Deep Features of Convolutional Neural Nets

2017-09-08 · Ali Mahdi, Jun Qin

A deep feature based saliency model (DeepFeat) is developed to leverage the understanding of the prediction of human fixations. Traditional saliency models often predict the human visual attention relying on few level im…

An Integration of Bottom-up and Top-Down Salient Cues on RGB-D Data: Saliency from Objectness vs. Non-Objectness

2018-07-04 · Nevrez Imamoglu, Wataru Shimoda, Chi Zhang, Yuming Fang 외

Bottom-up and top-down visual cues are two types of information that helps the visual saliency models. These salient cues can be from spatial distributions of the features (space-based saliency) or contextual / task-depe…

Object object-detection Object Detection RGB Salient Object Detection+1

An End-to-End Network for Co-Saliency Detection in One Single Image

2019-10-25 · Yuanhao Yue, Qin Zou, Hongkai Yu, Qian Wang 외

Co-saliency detection within a single image is a common vision problem that has received little attention and has not yet been well addressed. Existing methods often used a bottom-up strategy to infer co-saliency in an i…

Clustering Co-Salient Object Detection Saliency Detection Saliency Prediction+1

An Iterative and Cooperative Top-Down and Bottom-Up Inference Network for Salient Object Detection

2019-06-01 · CVPR 2019 6 · Wenguan Wang, Jianbing Shen, Ming-Ming Cheng, Ling Shao

This paper presents a salient object detection method that integrates both top-down and bottom-up saliency inference in an iterative and cooperative manner. The top-down process is used for coarse-to-fine saliency estima…

object-detection Object Detection RGB Salient Object Detection Saliency Prediction+1