paper-with-me

Papers

Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion

2024-06-14 · Runze Liu, DongChen zhu, Guanghui Zhang, Yue Xu, Wenjun Shi, Xiaolin Zhang, Lei Wang, Jiamao Li

Unsupervised monocular depth estimation has received widespread attention because of its capability to train without ground truth. In real-world scenarios, the images may be blurry or noisy due to the influence of weather conditions and inherent limitations of the camera. Therefore, it is particularly important to develop a robust depth estimation model. Benefiting from the training strategies of generative networks, generative-based methods often exhibit enhanced robustness. In light of this, we employ a well-converging diffusion model among generative networks for unsupervised monocular depth estimation. Additionally, we propose a hierarchical feature-guided denoising module. This model significantly enriches the model's capacity for learning and interpreting depth distribution by fully leveraging image features to guide the denoising process. Furthermore, we explore the implicit depth within reprojection and design an implicit depth consistency loss. This loss function serves to enhance the performance of the model and ensure the scale consistency of depth within a video sequence. We conduct experiments on the KITTI, Make3D, and our self-collected SIMIT datasets. The results indicate that our approach stands out among generative-based models, while also showcasing remarkable robustness.

📄 PDF Abstract BibTeX arXiv:2406.09782

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingDepth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

3D Hierarchical Refinement and Augmentation for Unsupervised Learning of Depth and Pose from Monocular Video

2021-12-06 · Guangming Wang, Jiquan Zhong, Shijie Zhao, Wenhua Wu 외

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabel…

3D geometryAutonomous DrivingDepth EstimationImage Augmentation+2

Unsupervised monocular stereo matching

2018-12-31 · Zhimin Zhang, Jianzhong Qiao, Shukuan Lin

At present, deep learning has been applied more and more in monocular image depth estimation and has shown promising results. The current more ideal method for monocular depth estimation is the supervised learning based …

Depth EstimationMonocular Depth EstimationStereo MatchingStereo Matching Hand

SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Network

2023-01-17 · Dongseok Shim, H. Jin Kim

Monocular depth estimation plays a critical role in various computer vision and robotics applications such as localization, mapping, and 3D object detection. Recently, learning-based algorithms achieve huge success in de…

3D Object DetectionDecoderDepth EstimationMonocular Depth Estimation+2

MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation

2020-06-27 · Jun Liu, Qing Li, Rui Cao, Wenming Tang 외

Predicting depth from a single image is an attractive research topic since it provides one more dimension of information to enable machines to better perceive the world. Recently, deep learning has emerged as an effectiv…

CPUDepth EstimationDepth PredictionGPU+4

Unsupervised Learning of Depth and Deep Representation for Visual Odometry from Monocular Videos in a Metric Space

2019-08-04 · Xiaochuan Yin, Chengju Liu

For ego-motion estimation, the feature representation of the scenes is crucial. Previous methods indicate that both the low-level and semantic feature-based methods can achieve promising results. Therefore, the incorpora…

Depth EstimationMotion EstimationRepresentation LearningText-to-Image Generation+2