paper-with-me

홈 › Papers

Learning a Geometric Representation for Data-Efficient Depth Estimation via Gradient Field and Contrastive Loss

2020-11-06 · Dongseok Shim, H. Jin Kim

Estimating a depth map from a single RGB image has been investigated widely for localization, mapping, and 3-dimensional object detection. Recent studies on a single-view depth estimation are mostly based on deep Convolutional neural Networks (ConvNets) which require a large amount of training data paired with densely annotated labels. Depth annotation tasks are both expensive and inefficient, so it is inevitable to leverage RGB images which can be collected very easily to boost the performance of ConvNets without depth labels. However, most self-supervised learning algorithms are focused on capturing the semantic information of images to improve the performance in classification or object detection, not in depth estimation. In this paper, we show that existing self-supervised methods do not perform well on depth estimation and propose a gradient-based self-supervised learning algorithm with momentum contrastive loss to help ConvNets extract the geometric information with unlabeled images. As a result, the network can estimate the depth map accurately with a relatively small amount of annotated data. To show that our method is independent of the model structure, we evaluate our method with two different monocular depth estimation algorithms. Our method outperforms the previous state-of-the-art self-supervised learning algorithms and shows the efficiency of labeled data in triple compared to random initialization on the NYU Depth v2 dataset.

📄 PDF Abstract BibTeX arXiv:2011.03207

Code (1)

dsshim0125/grmc 공식 구현 pytorch

Tasks

Depth EstimationMonocular Depth Estimationobject-detectionObject DetectionSelf-Supervised Learning

Similar Papers 제목 키워드 기반

DeepV2D: Video to Depth with Differentiable Structure from Motion

2018-12-11 · ICLR 2020 1 · Zachary Teed, Jia Deng

We propose DeepV2D, an end-to-end deep learning architecture for predicting depth from video. DeepV2D combines the representation ability of neural networks with the geometric principles governing image formation. We com…

3D Scene ReconstructionDepth EstimationMotion EstimationOptical Flow Estimation+1

Depth Field Networks for Generalizable Multi-view Scene Representation

2022-07-28 · Vitor Guizilini, Igor Vasiljevic, Jiading Fang, Rares Ambrus 외

Modern 3D computer vision leverages learning to boost geometric reasoning, mapping image data to classical structures such as cost volumes or epipolar constraints to improve matching. These architectures are specialized …

Data AugmentationDepth EstimationDiversityDomain Generalization+1

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues

2024-03-04 · Rui Lourenço, Lucas Thomaz, Eduardo A. B. Silva, Sergio M. M. Faria

Light field cameras and multi-camera arrays have emerged as promising solutions for accurately estimating depth by passively capturing light information. This is possible because the 3D information of a scene is embedded…

Depth EstimationDisparity Estimation

Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360° Images

2024-11-04 · Kun Huang, Fang-Lue Zhang, Fangfang Zhang, Yu-Kun Lai 외

Geometric estimation is required for scene understanding and analysis in panoramic 360{\deg} images. Current methods usually predict a single feature, such as depth or surface normal. These methods can lack robustness, e…

Multi-Task LearningScene UnderstandingSurface Normal Estimation

D2NT: A High-Performing Depth-to-Normal Translator

2023-04-24 · Yi Feng, Bohuan Xue, Ming Liu, Qijun Chen 외

Surface normal holds significant importance in visual environmental perception, serving as a source of rich geometric information. However, the state-of-the-art (SoTA) surface normal estimators (SNEs) generally suffer fr…

Surface Normal EstimationVocal Bursts Intensity Prediction