Attention-based Dual Supervised Decoder for RGBD Semantic Segmentation
Encoder-decoder models have been widely used in RGBD semantic segmentation, and most of them are designed via a two-stream network. In general, jointly reasoning the color and geometric information from RGBD is beneficial for semantic segmentation. However, most existing approaches fail to comprehensively utilize multimodal information in both the encoder and decoder. In this paper, we propose a novel attention-based dual supervised decoder for RGBD semantic segmentation. In the encoder, we design a simple yet effective attention-based multimodal fusion module to extract and fuse deeply multi-level paired complementary information. To learn more robust deep representations and rich multi-modal information, we introduce a dual-branch decoder to effectively leverage the correlations and complementary cues of different tasks. Extensive experiments on NYUDv2 and SUN-RGBD datasets demonstrate that our method achieves superior performance against the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderRGBD Semantic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Attention-based Multi-modal Fusion Network for Semantic Scene Completion
This paper presents an end-to-end 3D convolutional network named attention-based multi-modal fusion network (AMFNet) for the semantic scene completion (SSC) task of inferring the occupancy and semantic labels of a volume…
2D Semantic Segmentation3D Semantic Scene CompletionSegmentationSemantic SegmentationDFormerv2: Geometry Self-Attention for RGBD Semantic Segmentation
Recent advances in scene understanding benefit a lot from depth maps because of the 3D geometry information, especially in complex conditions (e.g., low light and overexposed). Existing approaches encode depth maps along…
3D geometryRGBD Semantic SegmentationScene UnderstandingSemantic SegmentationMVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry
Monocular visual odometry (MVO) is foundational to autonomous navigation and robotic localization. However, existing learning-based MVO approaches often struggle with either a lack of interpretable, complementary feature…
Zero-shot GeneralizationDomain GeneralizationVisual OdometryACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation
Compared to RGB semantic segmentation, RGBD semantic segmentation can achieve better performance by taking depth information into consideration. However, it is still problematic for contemporary segmenters to effectively…
RGBD Semantic SegmentationSegmentationSemantic SegmentationThermal Image SegmentationLearning Dual-Fused Modality-Aware Representations for RGBD Tracking
With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve …
Object Tracking