Multi-interactive Dual-decoder for RGB-thermal Salient Object Detection
RGB-thermal salient object detection (SOD) aims to segment the common prominent regions of visible image and corresponding thermal infrared image that we call it RGBT SOD. Existing methods don't fully explore and exploit the potentials of complementarity of different modalities and multi-type cues of image contents, which play a vital role in achieving accurate results. In this paper, we propose a multi-interactive dual-decoder to mine and model the multi-type interactions for accurate RGBT SOD. In specific, we first encode two modalities into multi-level multi-modal feature representations. Then, we design a novel dual-decoder to conduct the interactions of multi-level features, two modalities and global contexts. With these interactions, our method works well in diversely challenging scenarios even in the presence of invalid modality. Finally, we carry out extensive experiments on public RGBT and RGBD SOD datasets, and the results show that the proposed method achieves the outstanding performance against state-of-the-art algorithms. The source code has been released at:https://github.com/lz118/Multi-interactive-Dual-decoder.
Code (2)
Tasks
Decoderobject-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionSimilar Papers 제목 키워드 기반
Multi-interactive Encoder-decoder Network for RGBT Salient Object Detection
RGBT salient object detection (SOD) aims to segment the common prominent regions of visible and thermal infrared images. Existing RGBT SOD methods don't fully explore and exploit the potentials of complementarity of diff…
Decoderobject-detectionObject DetectionSalient Object DetectionSSFam: Scribble Supervised Salient Object Detection Family
Scribble supervised salient object detection (SSSOD) constructs segmentation ability of attractive objects from surroundings under the supervision of sparse scribble labels. For the better segmentation, depth and thermal…
DecoderObjectobject-detectionObject Detection+2Interactive Context-Aware Network for RGB-T Salient Object Detection
Salient object detection (SOD) focuses on distinguishing the most conspicuous objects in the scene. However, most related works are based on RGB images, which lose massive useful information. Accordingly, with the maturi…
object-detectionObject DetectionRGB-T Salient Object DetectionSalient Object DetectionDeep Fourier-embedded Network for Bi-modal Salient Object Detection
The rapid development of deep learning provides a significant improvement of salient object detection combining both RGB and thermal images. However, existing deep learning-based models suffer from two major shortcomings…
object-detectionObject DetectionSalient Object DetectionPosition-Aware Relation Learning for RGB-Thermal Salient Object Detection
RGB-Thermal salient object detection (SOD) combines two spectra to segment visually conspicuous regions in images. Most existing methods use boundary maps to learn the sharp boundary. These methods ignore the interaction…
DecoderObjectobject-detectionObject Detection+3