paper-with-me

홈 › Papers

FastSal: a Computationally Efficient Network for Visual Saliency Prediction

2020-08-25 · Feiyan Hu, Kevin McGuinness

This paper focuses on the problem of visual saliency prediction, predicting regions of an image that tend to attract human visual attention, under a constrained computational budget. We modify and test various recent efficient convolutional neural network architectures like EfficientNet and MobileNetV2 and compare them with existing state-of-the-art saliency models such as SalGAN and DeepGaze II both in terms of standard accuracy metrics like AUC and NSS, and in terms of the computational complexity and model size. We find that MobileNetV2 makes an excellent backbone for a visual saliency model and can be effective even without a complex decoder. We also show that knowledge transfer from a more computationally expensive model like DeepGaze II can be achieved via pseudo-labelling an unlabelled dataset, and that this approach gives result on-par with many state-of-the-art algorithms with a fraction of the computational cost and model size. Source code is available at https://github.com/feiyanhu/FastSal.

📄 PDF Abstract BibTeX arXiv:2008.11151

Code (1)

feiyanhu/FastSal 공식 구현 pytorch

Tasks

DecoderPredictionSaliency PredictionTransfer Learning

Methods 이 논문이 사용한 방법론

RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
Batch Normalization 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Inverted Residual Block 설명 없음
Sigmoid Activation 설명 없음

Similar Papers 제목 키워드 기반

A Dilated Inception Network for Visual Saliency Prediction

2019-04-07 · Sheng Yang, Guosheng Lin, Qiuping Jiang, Weisi Lin

Recently, with the advent of deep convolutional neural networks (DCNN), the improvements in visual saliency prediction research are impressive. One possible direction to approach the next improvement is to fully characte…

DiversityPredictionSaliency PredictionVideo Saliency Detection

On the connections between saliency and tracking

2012-12-01 · NeurIPS 2012 12 · Vijay Mahadevan, Nuno Vasconcelos

A model connecting visual tracking and saliency has recently been proposed. This model is based on the saliency hypothesis for tracking which postulates that tracking is achieved by the top-down tuning, based on target f…

Visual Tracking

MRGAN360: Multi-stage Recurrent Generative Adversarial Network for 360 Degree Image Saliency Prediction

2023-03-15 · Pan Gao, Xinlang Chen, Rong Quan, Wei Xiang

Thanks to the ability of providing an immersive and interactive experience, the uptake of 360 degree image content has been rapidly growing in consumer and industrial applications. Compared to planar 2D images, saliency …

Generative Adversarial NetworkPredictionSaliency Prediction

TinyHD: Efficient Video Saliency Prediction with Heterogeneous Decoders using Hierarchical Maps Distillation

2023-01-11 · Feiyan Hu, Simone Palazzo, Federica Proietto Salanitri, Giovanni Bellitto 외

Video saliency prediction has recently attracted attention of the research community, as it is an upstream task for several practical applications. However, current solutions are particularly computationally demanding, e…

Knowledge DistillationPredictionSaliency PredictionVideo Saliency Prediction

Saccade Sequence Prediction: Beyond Static Saliency Maps

2017-11-29 · Calden Wloka, Iuliia Kotseruba, John K. Tsotsos

Visual attention is a field with a considerable history, with eye movement control and prediction forming an important subfield. Fixation modeling in the past decades has been largely dominated computationally by a numbe…

Prediction