SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detection
RGB-D salient object detection (SOD) has been in the spotlight recently because it is an important preprocessing operation for various vision tasks. However, despite advances in deep learning-based methods, RGB-D SOD is still challenging due to the large domain gap between an RGB image and the depth map and low-quality depth maps. To solve this problem, we propose a novel superpixel prototype sampling network (SPSN) architecture. The proposed model splits the input RGB image and depth map into component superpixels to generate component prototypes. We design a prototype sampling network so that the network only samples prototypes corresponding to salient objects. In addition, we propose a reliance selection module to recognize the quality of each RGB and depth feature map and adaptively weight them in proportion to their reliability. The proposed method makes the model robust to inconsistencies between RGB images and depth maps and eliminates the influence of non-salient objects. Our method is evaluated on five popular datasets, achieving state-of-the-art performance. We prove the effectiveness of the proposed method through comparative experiments.
Code (1)
Tasks
object-detectionObject DetectionRGB-D Salient Object DetectionSalient Object DetectionSuperpixelsSimilar Papers 제목 키워드 기반
Unsupervised Video Object Segmentation via Prototype Memory Network
Unsupervised video object segmentation aims to segment a target object in the video without a ground truth mask in the initial frame. This challenging task requires extracting features for the most salient common objects…
ObjectOptical Flow EstimationSelf-LearningSemantic Segmentation+3Learning Optimal Seeds for Diffusion-based Salient Object Detection
In diffusion-based saliency detection, an image is partitioned into superpixels and mapped to a graph, with superpixels as nodes and edge strengths proportional to superpixel similarity. Saliency information is then prop…
Objectobject-detectionObject DetectionRGB Salient Object Detection+3Memory-Efficient Deep Salient Object Segmentation Networks on Gridized Superpixels
Computer vision algorithms with pixel-wise labeling tasks, such as semantic segmentation and salient object detection, have gone through a significant accuracy increase with the incorporation of deep learning. Deep segme…
Objectobject-detectionObject DetectionRGB Salient Object Detection+4STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection
Transformer-based methods for RGB-D Salient Object Detection (SOD) have gained significant interest, owing to the transformer's exceptional capacity to capture long-range pixel dependencies. Nevertheless, current RGB-D S…
RGB-D Salient Object DetectionA Modified Sigma-Pi-Sigma Neural Network with Adaptive Choice of Multinomials
Sigma-Pi-Sigma neural networks (SPSNNs) as a kind of high-order neural networks can provide more powerful mapping capability than the traditional feedforward neural networks (Sigma-Sigma neural networks). In the existing…