paper-with-me

Papers

DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimation

2023-03-09 · Yiqun Duan, Xianda Guo, Zheng Zhu

Monocular depth estimation is a challenging task that predicts the pixel-wise depth from a single 2D image. Current methods typically model this problem as a regression or classification task. We propose DiffusionDepth, a new approach that reformulates monocular depth estimation as a denoising diffusion process. It learns an iterative denoising process to `denoise' random depth distribution into a depth map with the guidance of monocular visual conditions. The process is performed in the latent space encoded by a dedicated depth encoder and decoder. Instead of diffusing ground truth (GT) depth, the model learns to reverse the process of diffusing the refined depth of itself into random depth distribution. This self-diffusion formulation overcomes the difficulty of applying generative models to sparse GT depth scenarios. The proposed approach benefits this task by refining depth estimation step by step, which is superior for generating accurate and highly detailed depth maps. Experimental results on KITTI and NYU-Depth-V2 datasets suggest that a simple yet efficient diffusion approach could reach state-of-the-art performance in both indoor and outdoor scenarios with acceptable inference time.

📄 PDF Abstract BibTeX arXiv:2303.05021

Code (1)

duanyiqun/diffusiondepth 공식 구현 pytorch

Tasks

DecoderDenoisingDepth EstimationMonocular Depth Estimation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Model

2023-11-13 · Shuwei Shao, Zhongcai Pei, Weihai Chen, Dingchi Sun 외

Over the past few years, self-supervised monocular depth estimation that does not depend on ground-truth during the training phase has received widespread attention. Most efforts focus on designing different types of net…

DenoisingDepth EstimationMonocular Depth Estimation

Monocular Depth Estimation using Diffusion Models

2023-02-28 · Saurabh Saxena, Abhishek Kar, Mohammad Norouzi, David J. Fleet

We formulate monocular depth estimation using denoising diffusion models, inspired by their recent successes in high fidelity image generation. To that end, we introduce innovations to address problems arising due to noi…

DenoisingDepth EstimationImage GenerationImage-to-Image Translation+3

PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation

2024-11-24 · Ziyao Zeng, Jingcheng Ni, Daniel Wang, Patrick Rim 외

Traditional monocular depth estimation suffers from inherent ambiguity and visual nuisance. We argue that language prior can enhance monocular depth estimation by leveraging the inductive bias learned during the text-to-…

DenoisingDepth EstimationInductive BiasMonocular Depth Estimation

Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion

2024-06-14 · Runze Liu, DongChen zhu, Guanghui Zhang, Yue Xu 외

Unsupervised monocular depth estimation has received widespread attention because of its capability to train without ground truth. In real-world scenarios, the images may be blurry or noisy due to the influence of weathe…

DenoisingDepth EstimationMonocular Depth EstimationUnsupervised Monocular Depth Estimation

The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation

2023-06-02 · NeurIPS 2023 11 · Saurabh Saxena, Charles Herrmann, Junhwa Hur, Abhishek Kar 외

Denoising diffusion probabilistic models have transformed image generation with their impressive fidelity and diversity. We show that they also excel in estimating optical flow and monocular depth, surprisingly, without …

DenoisingDepth EstimationDiversityImage Generation+3