Towards Comprehensive Representation Enhancement in Semantics-guided Self-supervised Monocular Depth Estimation
Semantics-guided self-supervised monocular depth estimation has been widely researched, owing to the strong cross-task correlation of depth and semantics. However, since depth estimation and semantic segmentation are fundamentally two types of tasks: one is regression while the other is classification, the distribution of depth feature and semantic feature are naturally different. Previous works that leverage semantic information in depth estimation mostly neglect such representational discrimination, which leads to insufficient representation enhancement of depth feature. In this work, we propose an attentionbased module to enhance task-specific feature by addressing their feature uniqueness within instances. Additionally, we propose a metric learning based approach to accomplish comprehensive enhancement on depth feature by creating a separation between instances in feature space. Extensive experiments and analysis demonstrate the effectiveness of our proposed method. In the end, our method achieves the state-of-the-art performance on KITTI dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMetric LearningMonocular Depth EstimationSemantic SegmentationUnsupervised Monocular Depth EstimationSimilar Papers 제목 키워드 기반
Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimation
Self-supervised monocular depth estimation has been widely studied, owing to its practical importance and recent promising improvements. However, most works suffer from limited supervision of photometric consistency, esp…
Depth EstimationMetric LearningMonocular Depth EstimationDecouple and Rectify: Semantics-Preserving Structural Enhancement for Open-Vocabulary Remote Sensing Segmentation
Open-vocabulary semantic segmentation in the remote sensing (RS) field requires both language-aligned recognition and fine-grained spatial delineation. Although CLIP offers robust semantic generalization, its global-alig…
Semantic SegmentationSemantic-Guided Representation Enhancement for Self-supervised Monocular Trained Depth Estimation
Self-supervised depth estimation has shown its great effectiveness in producing high quality depth maps given only image sequences as input. However, its performance usually drops when estimating on border areas or objec…
Depth EstimationSemantic SegmentationTowards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design
Current Low-light Image Enhancement (LLIE) techniques predominantly rely on either direct Low-Light (LL) to Normal-Light (NL) mappings or guidance from semantic features or illumination maps. Nonetheless, the intrinsic i…
Image EnhancementLow-Light Image EnhancementRetinex Meets Language: A Physics-Semantics-Guided Underwater Image Enhancement Network
Underwater images often suffer from severe degradation caused by light absorption and scattering, leading to color distortion, low contrast and reduced visibility. Existing Underwater Image Enhancement (UIE) methods can …
Semantic SimilarityImage Enhancement