paper-with-me

홈 › Papers

A Dilated Inception Network for Visual Saliency Prediction

2019-04-07 · Sheng Yang, Guosheng Lin, Qiuping Jiang, Weisi Lin

Recently, with the advent of deep convolutional neural networks (DCNN), the improvements in visual saliency prediction research are impressive. One possible direction to approach the next improvement is to fully characterize the multi-scale saliency-influential factors with a computationally-friendly module in DCNN architectures. In this work, we proposed an end-to-end dilated inception network (DINet) for visual saliency prediction. It captures multi-scale contextual features effectively with very limited extra parameters. Instead of utilizing parallel standard convolutions with different kernel sizes as the existing inception module, our proposed dilated inception module (DIM) uses parallel dilated convolutions with different dilation rates which can significantly reduce the computation load while enriching the diversity of receptive fields in feature maps. Moreover, the performance of our saliency model is further improved by using a set of linear normalization-based probability distribution distance metrics as loss functions. As such, we can formulate saliency prediction as a probability distribution prediction task for global saliency inference instead of a typical pixel-wise regression problem. Experimental results on several challenging saliency benchmark datasets demonstrate that our DINet with proposed loss functions can achieve state-of-the-art performance with shorter inference time.

📄 PDF Abstract BibTeX arXiv:1904.03571

Code (1)

ysyscool/DINet 공식 구현 tf

Tasks

DiversityPredictionSaliency PredictionVideo Saliency Detection

Methods 이 논문이 사용한 방법론

DCNN Diffusion-convolutional neural networks (DCNN) is a model for graph-structured data. Through the introduction of a diffusion-convolution operation, diffusion-based representations…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Inception Module An Inception Module is an image model block that aims to approximate an optimal local sparse structure in a CNN. Put simply, it allows for us to use multiple types of filter…

Similar Papers 제목 키워드 기반

Single Image Super-Resolution with Dilated Convolution based Multi-Scale Information Learning Inception Module

2017-07-22 · Wuzhen Shi, Feng Jiang, Debin Zhao

Traditional works have shown that patches in a natural image tend to redundantly recur many times inside the image, both within the same scale, as well as across different scales. Make full use of these multi-scale infor…

Image RestorationImage Super-ResolutionSuper-Resolution

Inception Convolution with Efficient Dilation Search

2020-12-25 · CVPR 2021 1 · Jie Liu, Chuming Li, Feng Liang, Chen Lin 외

As a variant of standard convolution, a dilated convolution can control effective receptive fields and handle large scale variance of objects without introducing additional computational costs. To fully explore the poten…

Human DetectionInstance Segmentationobject-detectionObject Detection+2

Saliency Unified: A Deep Architecture for Simultaneous Eye Fixation Prediction and Salient Object Segmentation

2016-06-01 · CVPR 2016 6 · Srinivas S. S. Kruthiventi, Vennela Gudisa, Jaley H. Dholakiya, R. Venkatesh Babu

Human eye fixations often correlate with locations of salient objects in the scene. However, only a handful of approaches have attempted to simultaneously address the related aspects of eye fixations and object saliency.…

ObjectSemantic Segmentation

Deep Reasoning with Multi-Scale Context for Salient Object Detection

2019-01-24 · Zun Li, Congyan Lang, Yunpeng Chen, Junhao Liew 외

To detect salient objects accurately, existing methods usually design complex backbone network architectures to learn and fuse powerful features. However, the saliency inference module that performs saliency prediction f…

object-detectionObject DetectionRGB Salient Object DetectionSaliency Detection+2

DAVE: A Deep Audio-Visual Embedding for Dynamic Saliency Prediction

2019-05-25 · Hamed R. -Tavakoli, Ali Borji, Esa Rahtu, Juho Kannala

This paper studies audio-visual deep saliency prediction. It introduces a conceptually simple and effective Deep Audio-Visual Embedding for dynamic saliency prediction dubbed ``DAVE" in conjunction with our efforts towar…

DecoderPredictionSaliency PredictionVideo Saliency Prediction