paper-with-me

홈 › Papers

Attention-based Dual Supervised Decoder for RGBD Semantic Segmentation

2022-01-05 · Yang Zhang, Yang Yang, Chenyun Xiong, Guodong Sun, Yanwen Guo

Encoder-decoder models have been widely used in RGBD semantic segmentation, and most of them are designed via a two-stream network. In general, jointly reasoning the color and geometric information from RGBD is beneficial for semantic segmentation. However, most existing approaches fail to comprehensively utilize multimodal information in both the encoder and decoder. In this paper, we propose a novel attention-based dual supervised decoder for RGBD semantic segmentation. In the encoder, we design a simple yet effective attention-based multimodal fusion module to extract and fuse deeply multi-level paired complementary information. To learn more robust deep representations and rich multi-modal information, we introduce a dual-branch decoder to effectively leverage the correlations and complementary cues of different tasks. Extensive experiments on NYUDv2 and SUN-RGBD datasets demonstrate that our method achieves superior performance against the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2201.01427

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderRGBD Semantic SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Attention-based Multi-modal Fusion Network for Semantic Scene Completion

2020-03-31 · Siqi Li, Changqing Zou, Yipeng Li, Xibin Zhao 외

This paper presents an end-to-end 3D convolutional network named attention-based multi-modal fusion network (AMFNet) for the semantic scene completion (SSC) task of inferring the occupancy and semantic labels of a volume…

2D Semantic Segmentation3D Semantic Scene CompletionSegmentationSemantic Segmentation

DFormerv2: Geometry Self-Attention for RGBD Semantic Segmentation

2025-04-07 · CVPR 2025 1 · Bo-Wen Yin, Jiao-Long Cao, Ming-Ming Cheng, Qibin Hou

Recent advances in scene understanding benefit a lot from depth maps because of the 3D geometry information, especially in complex conditions (e.g., low light and overexposed). Existing approaches encode depth maps along…

3D geometryRGBD Semantic SegmentationScene UnderstandingSemantic Segmentation

MVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry

2026-06-15 · Jituo Li, Shunwang Sun, Jialu Zhang, Xinqi Liu 외 arxiv

Monocular visual odometry (MVO) is foundational to autonomous navigation and robotic localization. However, existing learning-based MVO approaches often struggle with either a lack of interpretable, complementary feature…

Zero-shot GeneralizationDomain GeneralizationVisual Odometry

ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation

2019-05-24 · Xinxin Hu, Kailun Yang, Lei Fei, Kaiwei Wang

Compared to RGB semantic segmentation, RGBD semantic segmentation can achieve better performance by taking depth information into consideration. However, it is still problematic for contemporary segmenters to effectively…

RGBD Semantic SegmentationSegmentationSemantic SegmentationThermal Image Segmentation

Learning Dual-Fused Modality-Aware Representations for RGBD Tracking

2022-11-06 · Shang Gao, Jinyu Yang, Zhe Li, Feng Zheng 외

With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve …

Object Tracking