Saliency for free: Saliency prediction as a side-effect of object recognition
Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via eyetracking experiments. In the current paper, we demonstrate that saliency maps can be generated as a side-effect of training an object recognition deep neural network that is endowed with a saliency branch. Such a network does not require any ground-truth saliency maps for training.Extensive experiments carried out on both real and synthetic saliency datasets demonstrate that our approach is able to generate accurate saliency maps, achieving competitive results on both synthetic and real datasets when compared to methods that do require ground truth data.
Code (0)
등록된 구현이 없습니다.
Tasks
Object RecognitionSaliency PredictionSimilar Papers 제목 키워드 기반
The Effect of Distortions on the Prediction of Visual Attention
Existing saliency models have been designed and evaluated for predicting the saliency in distortion-free images. However, in practice, the image quality is affected by a host of factors at several stages of the image pro…
Saliency PredictionTask-driven Webpage Saliency
In this paper, we present an end-to-end learning framework for predicting task-driven visual saliency on webpages. Given a webpage, we propose a convolutional neural network to predict where people look at it under diffe…
PredictionSaliency DetectionSaliency PredictionTask-Adaptive Saliency Guidance for Exemplar-free Class Incremental Learning
Exemplar-free Class Incremental Learning (EFCIL) aims to sequentially learn tasks with access only to data from the current one. EFCIL is of interest because it mitigates concerns about privacy and long-term storage of d…
class-incremental learningClass Incremental LearningExemplar-FreeIncremental LearningSaliency Prediction for Mobile User Interfaces
We introduce models for saliency prediction for mobile user interfaces. A mobile interface may include elements like buttons, text, etc. in addition to natural images which enable performing a variety of tasks. Saliency …
PredictionSaliency PredictionHow is Visual Attention Influenced by Text Guidance? Database and Model
The analysis and prediction of visual attention have long been crucial tasks in the fields of computer vision and image processing. In practical applications, images are generally accompanied by various text descriptions…
PredictionSaliency Prediction