paper-with-me

Papers

SteeredMarigold: Steering Diffusion Towards Depth Completion of Largely Incomplete Depth Maps

2024-09-16 · Jakub Gregorek, Lazaros Nalpantidis

Even if the depth maps captured by RGB-D sensors deployed in real environments are often characterized by large areas missing valid depth measurements, the vast majority of depth completion methods still assumes depth values covering all areas of the scene. To address this limitation, we introduce SteeredMarigold, a training-free, zero-shot depth completion method capable of producing metric dense depth, even for largely incomplete depth maps. SteeredMarigold achieves this by using the available sparse depth points as conditions to steer a denoising diffusion probabilistic model. Our method outperforms relevant top-performing methods on the NYUv2 dataset, in tests where no depth was provided for a large area, achieving state-of-art performance and exhibiting remarkable robustness against depth map incompleteness. Our source code is publicly available at https://steeredmarigold.github.io.

📄 PDF Abstract BibTeX arXiv:2409.10202

Code (1)

DTU-PAS/steered-marigold 공식 구현 pytorch

Tasks

DenoisingDepth Completionvalid

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior

2024-04-17 · Zhiheng Liu, Hao Ouyang, Qiuyu Wang, Ka Leong Cheng 외

3D Gaussians have recently emerged as an efficient representation for novel view synthesis. This work studies its editability with a particular focus on the inpainting task, which aims to supplement an incomplete set of …

Depth CompletionNovel View Synthesis

Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion

2024-12-18 · Massimiliano Viola, Kevin Qu, Nando Metzger, Bingxin Ke 외

Depth completion upgrades sparse depth measurements into dense depth maps guided by a conventional image. Existing methods for this highly ill-posed task operate in tightly constrained settings and tend to struggle when …

DenoisingDepth CompletionDepth EstimationMonocular Depth Estimation+1

DenseFormer: Learning Dense Depth Map from Sparse Depth and Image via Conditional Diffusion Model

2025-03-31 · Ming Yuan, Sichao Wang, Chuang Zhang, Lei He 외

The depth completion task is a critical problem in autonomous driving, involving the generation of dense depth maps from sparse depth maps and RGB images. Most existing methods employ a spatial propagation network to ite…

Autonomous DrivingDenoisingDepth Completion

DidSee: Diffusion-Based Depth Completion for Material-Agnostic Robotic Perception and Manipulation

2025-06-26 · Wenzhou Lyu, Jialing Lin, Wenqi Ren, Ruihao Xia 외

Commercial RGB-D cameras often produce noisy, incomplete depth maps for non-Lambertian objects. Traditional depth completion methods struggle to generalize due to the limited diversity and scale of training data. Recent …

Depth CompletionPose EstimationSemantic Segmentation

Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints

2019-10-15 · ICCV 2019 10 · Yan Xu, Xinge Zhu, Jianping Shi, Guofeng Zhang 외

Depth completion aims to recover dense depth maps from sparse depth measurements. It is of increasing importance for autonomous driving and draws increasing attention from the vision community. Most of existing methods d…

Autonomous DrivingDecoderDepth Completion