MobileSal: Extremely Efficient RGB-D Salient Object Detection
The high computational cost of neural networks has prevented recent successes in RGB-D salient object detection (SOD) from benefiting real-world applications. Hence, this paper introduces a novel network, MobileSal, which focuses on efficient RGB-D SOD using mobile networks for deep feature extraction. However, mobile networks are less powerful in feature representation than cumbersome networks. To this end, we observe that the depth information of color images can strengthen the feature representation related to SOD if leveraged properly. Therefore, we propose an implicit depth restoration (IDR) technique to strengthen the mobile networks' feature representation capability for RGB-D SOD. IDR is only adopted in the training phase and is omitted during testing, so it is computationally free. Besides, we propose compact pyramid refinement (CPR) for efficient multi-level feature aggregation to derive salient objects with clear boundaries. With IDR and CPR incorporated, MobileSal performs favorably against state-of-the-art methods on six challenging RGB-D SOD datasets with much faster speed (450fps for the input size of 320 $\times$ 320) and fewer parameters (6.5M). The code is released at https://mmcheng.net/mobilesal.
Code (1)
Tasks
Objectobject-detectionObject DetectionRGB-D Salient Object DetectionSalient Object DetectionSimilar Papers 제목 키워드 기반
Depth Quality-Inspired Feature Manipulation for Efficient RGB-D and Video Salient Object Detection
Recently CNN-based RGB-D salient object detection (SOD) has obtained significant improvement on detection accuracy. However, existing models often fail to perform well in terms of efficiency and accuracy simultaneously. …
CPUobject-detectionObject DetectionRGB-D Salient Object Detection+2EDN: Salient Object Detection via Extremely-Downsampled Network
Recent progress on salient object detection (SOD) mainly benefits from multi-scale learning, where the high-level and low-level features collaborate in locating salient objects and discovering fine details, respectively.…
DecoderObjectobject-detectionObject Detection+2Highly Efficient Salient Object Detection with 100K Parameters
Salient object detection models often demand a considerable amount of computation cost to make precise prediction for each pixel, making them hardly applicable on low-power devices. In this paper, we aim to relieve the c…
Objectobject-detectionObject DetectionRGB Salient Object Detection+1Seamless Detection: Unifying Salient Object Detection and Camouflaged Object Detection
Achieving joint learning of Salient Object Detection (SOD) and Camouflaged Object Detection (COD) is extremely challenging due to their distinct object characteristics, i.e., saliency and camouflage. The only preliminary…
DecoderObjectobject-detectionObject Detection+1Deep Learning for Object Saliency Detection and Image Segmentation
In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an …
Deep LearningGPUImage SegmentationObject+2