Predicting When Saliency Maps Are Accurate and Eye Fixations Consistent
Many computational models of visual attention use image features and machine learning techniques to predict eye fixation locations as saliency maps. Recently, the success of Deep Convolutional Neural Networks (DCNNs) for object recognition has opened a new avenue for computational models of visual attention due to the tight link between visual attention and object recognition. In this paper, we show that using features from DCNNs for object recognition we can make predictions that enrich the information provided by saliency models. Namely, we can estimate the reliability of a saliency model from the raw image, which serves as a meta-saliency measure that may be used to select the best saliency algorithm for an image. Analogously, the consistency of the eye fixations among subjects, i.e. the agreement between the eye fixation locations of different subjects, can also be predicted and used by a designer to assess whether subjects reach a consensus about salient image locations.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject RecognitionSimilar Papers 제목 키워드 기반
Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model
Data-driven saliency has recently gained a lot of attention thanks to the use of Convolutional Neural Networks for predicting gaze fixations. In this paper we go beyond standard approaches to saliency prediction, in whic…
Saliency PredictionSaliency Prediction on Omnidirectional Images with Generative Adversarial Imitation Learning
When watching omnidirectional images (ODIs), subjects can access different viewports by moving their heads. Therefore, it is necessary to predict subjects' head fixations on ODIs. Inspired by generative adversarial imita…
Deep Reinforcement LearningImitation LearningReinforcement LearningSaliency PredictionModeling human visual search: A combined Bayesian searcher and saliency map approach for eye movement guidance in natural scenes
Finding objects is essential for almost any daily-life visual task. Saliency models have been useful to predict fixation locations in natural images, but are static, i.e., they provide no information about the time-seque…
Saliency Map Estimation for Omni-Directional Image Considering Prior Distributions
In recent years, the deep learning techniques have been applied to the estimation of saliency maps, which represent probability density functions of fixations when people look at the images. Although the methods of salie…
Predicting Goal-directed Human Attention Using Inverse Reinforcement Learning
Being able to predict human gaze behavior has obvious importance for behavioral vision and for computer vision applications. Most models have mainly focused on predicting free-viewing behavior using saliency maps, but th…
Objectreinforcement-learningReinforcement LearningReinforcement Learning (RL)