An Iterative and Cooperative Top-Down and Bottom-Up Inference Network for Salient Object Detection
This paper presents a salient object detection method that integrates both top-down and bottom-up saliency inference in an iterative and cooperative manner. The top-down process is used for coarse-to-fine saliency estimation, where high-level saliency is gradually integrated with finer lower-layer features to obtain a fine-grained result. The bottom-up process infers the high-level, but rough saliency through gradually using upper-layer, semantically-richer features. These two processes are alternatively performed, where the bottom-up process uses the fine-grained saliency obtained from the top-down process to yield enhanced high-level saliency estimate, and the top-down process, in turn, is further benefited from the improved high-level information. The network layers in the bottom-up/top-down processes are equipped with recurrent mechanisms for layer-wise, step-by-step optimization. Thus, saliency information is effectively encouraged to flow in a bottom-up, top-down and intra-layer manner. We show that most other saliency models based on fully convolutional networks (FCNs) are essentially variants of our model. Extensive experiments on several famous benchmarks clearly demonstrate the superior performance, good generalization, and powerful learning ability of our proposed saliency inference framework.
Code (0)
등록된 구현이 없습니다.
Tasks
object-detectionObject DetectionRGB Salient Object DetectionSaliency PredictionSalient Object DetectionSimilar Papers 제목 키워드 기반
An Integration of Bottom-up and Top-Down Salient Cues on RGB-D Data: Saliency from Objectness vs. Non-Objectness
Bottom-up and top-down visual cues are two types of information that helps the visual saliency models. These salient cues can be from spatial distributions of the features (space-based saliency) or contextual / task-depe…
Objectobject-detectionObject DetectionRGB Salient Object Detection+1Multi-Scale Iterative Refinement Network for RGB-D Salient Object Detection
The extensive research leveraging RGB-D information has been exploited in salient object detection. However, salient visual cues appear in various scales and resolutions of RGB images due to semantic gaps at different fe…
Objectobject-detectionObject DetectionRGB-D Salient Object Detection+1Global and Local Sensitivity Guided Key Salient Object Re-augmentation for Video Saliency Detection
The existing still-static deep learning based saliency researches do not consider the weighting and highlighting of extracted features from different layers, all features contribute equally to the final saliency decision…
Decision Makingfeature selectionObjectSaliency Detection+2Unsupervised image saliency detection with Gestalt-laws guided optimization and visual attention based refinement
Visual attention is a kind of fundamental cognitive capability that allows human beings to focus on the region of interests (ROIs) under complex natural environments. What kind of ROIs that we pay attention to mainly dep…
object-detectionObject DetectionSaliency DetectionSalient Object DetectionAn End-to-End Network for Co-Saliency Detection in One Single Image
Co-saliency detection within a single image is a common vision problem that has received little attention and has not yet been well addressed. Existing methods often used a bottom-up strategy to infer co-saliency in an i…
ClusteringCo-Salient Object DetectionSaliency DetectionSaliency Prediction+1