Visual Attention driven by Convolutional Features
The understanding of where humans look in a scene is a problem of great interest in visual perception and computer vision. When eye-tracking devices are not a viable option, models of human attention can be used to predict fixations. In this paper we give two contribution. First, we show a model of visual attention that is simply based on deep convolutional neural networks trained for object classification tasks. A method for visualizing saliency maps is defined which is evaluated in a saliency prediction task. Second, we integrate the information of these maps with a bottom-up differential model of eye-movements to simulate visual attention scanpaths. Results on saliency prediction and scores of similarity with human scanpaths demonstrate the effectiveness of this model.
Code (0)
등록된 구현이 없습니다.
Tasks
Saliency PredictionSimilar Papers 제목 키워드 기반
Task-driven Webpage Saliency
In this paper, we present an end-to-end learning framework for predicting task-driven visual saliency on webpages. Given a webpage, we propose a convolutional neural network to predict where people look at it under diffe…
PredictionSaliency DetectionSaliency PredictionA dynamic vision sensor object recognition model based on trainable event-driven convolution and spiking attention mechanism
Spiking Neural Networks (SNNs) are well-suited for processing event streams from Dynamic Visual Sensors (DVSs) due to their use of sparse spike-based coding and asynchronous event-driven computation. To extract features …
Object RecognitionAn attention-driven hierarchical multi-scale representation for visual recognition
Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and com…
Decision MakingFine-Grained Visual RecognitionSTNet: Selective Tuning of Convolutional Networks for Object Localization
Visual attention modeling has recently gained momentum in developing visual hierarchies provided by Convolutional Neural Networks. Despite recent successes of feedforward processing on the abstraction of concepts form ra…
ObjectObject LocalizationLandmark Guided Visual Feature Extractor for Visual Speech Recognition with Limited Resource
Visual speech recognition is a technique to identify spoken content in silent speech videos, which has raised significant attention in recent years. Advancements in data-driven deep learning methods have significantly im…
Visual Speech Recognition