paper-with-me

홈 › Papers

Dynamo-Depth: Fixing Unsupervised Depth Estimation for Dynamical Scenes

2023-10-29 · NeurIPS 2023 11

Unsupervised monocular depth estimation techniques have demonstrated encouraging results but typically assume that the scene is static. These techniques suffer when trained on dynamical scenes, where apparent object motion can equally be explained by hypothesizing the object's independent motion, or by altering its depth. This ambiguity causes depth estimators to predict erroneous depth for moving objects. To resolve this issue, we introduce Dynamo-Depth, an unifying approach that disambiguates dynamical motion by jointly learning monocular depth, 3D independent flow field, and motion segmentation from unlabeled monocular videos. Specifically, we offer our key insight that a good initial estimation of motion segmentation is sufficient for jointly learning depth and independent motion despite the fundamental underlying ambiguity. Our proposed method achieves state-of-the-art performance on monocular depth estimation on Waymo Open and nuScenes Dataset with significant improvement in the depth of moving objects. Code and additional results are available at https://dynamo-depth.github.io.

📄 PDF Abstract BibTeX arXiv:2310.18887

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationMonocular Depth EstimationMotion SegmentationSegmentationUnsupervised Monocular Depth Estimation

Similar Papers 제목 키워드 기반

StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completion

2025-12-15 · Sangmin Hong, Suyoung Lee, Kyoung Mu Lee arxiv

The problem of depth completion involves predicting a dense depth image from a single sparse depth map and an RGB image. Unsupervised depth completion methods have been proposed for various datasets where ground truth de…

Monocular Depth EstimationDepth Completion

Unsupervised monocular stereo matching

2018-12-31 · Zhimin Zhang, Jianzhong Qiao, Shukuan Lin

At present, deep learning has been applied more and more in monocular image depth estimation and has shown promising results. The current more ideal method for monocular depth estimation is the supervised learning based …

Depth EstimationMonocular Depth EstimationStereo MatchingStereo Matching Hand

Dual CNN Models for Unsupervised Monocular Depth Estimation

2018-04-16 · Vamshi Krishna Repala, Shiv Ram Dubey

The unsupervised depth estimation is the recent trend by utilizing the binocular stereo images to get rid of depth map ground truth. In unsupervised depth computation, the disparity images are generated by training the C…

Depth EstimationImage ReconstructionMonocular Depth EstimationUnsupervised Monocular Depth Estimation

Pseudo Supervised Monocular Depth Estimation with Teacher-Student Network

2021-10-22 · Huan Liu, Junsong Yuan, Chen Wang, Jun Chen

Despite recent improvement of supervised monocular depth estimation, the lack of high quality pixel-wise ground truth annotations has become a major hurdle for further progress. In this work, we propose a new unsupervise…

Depth EstimationKnowledge DistillationMonocular Depth EstimationUnsupervised Monocular Depth Estimation

Back to the Color: Learning Depth to Specific Color Transformation for Unsupervised Depth Estimation

2024-06-11 · Yufan Zhu, Chongzhi Ran, Mingtao Feng, Fangfang Wu 외

Virtual engines can generate dense depth maps for various synthetic scenes, making them invaluable for training depth estimation models. However, discrepancies between synthetic and real-world colors pose significant cha…

Depth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation