SDNet: Semantically Guided Depth Estimation Network
Autonomous vehicles and robots require a full scene understanding of the environment to interact with it. Such a perception typically incorporates pixel-wise knowledge of the depths and semantic labels for each image from a video sensor. Recent learning-based methods estimate both types of information independently using two separate CNNs. In this paper, we propose a model that is able to predict both outputs simultaneously, which leads to improved results and even reduced computational costs compared to independent estimation of depth and semantics. We also empirically prove that the CNN is capable of learning more meaningful and semantically richer features. Furthermore, our SDNet estimates the depth based on ordinal classification. On the basis of these two enhancements, our proposed method achieves state-of-the-art results in semantic segmentation and depth estimation from single monocular input images on two challenging datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesDepth EstimationOrdinal ClassificationScene UnderstandingSemantic SegmentationSimilar Papers 제목 키워드 기반
Spherical Space Feature Decomposition for Guided Depth Map Super-Resolution
Guided depth map super-resolution (GDSR), as a hot topic in multi-modal image processing, aims to upsample low-resolution (LR) depth maps with additional information involved in high-resolution (HR) RGB images from the s…
Contrastive LearningDepth Map Super-ResolutionSuper-ResolutionPhysDNet: Physics-Guided Decomposition Network of Side-Scan Sonar Imagery
Side-scan sonar (SSS) imagery is widely used for seafloor mapping and underwater remote sensing, yet the measured intensity is strongly influenced by seabed reflectivity, terrain elevation, and acoustic path loss. This e…
CSDNet: Detect Salient Object in Depth-Thermal via A Lightweight Cross Shallow and Deep Perception Network
While we enjoy the richness and informativeness of multimodal data, it also introduces interference and redundancy of information. To achieve optimal domain interpretation with limited resources, we propose CSDNet, a lig…
DescriptiveInformativenessobject-detectionObject Detection+1Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidance
Self-supervised monocular depth estimation presents a powerful method to obtain 3D scene information from single camera images, which is trainable on arbitrary image sequences without requiring depth labels, e.g., from a…
Depth EstimationMonocular Depth EstimationSemantic SegmentationLearning Deep Context-Sensitive Decomposition for Low-Light Image Enhancement
Enhancing the quality of low-light images plays a very important role in many image processing and multimedia applications. In recent years, a variety of deep learning techniques have been developed to address this chall…
Image EnhancementLow-Light Image Enhancement