Diffusion-Augmented Depth Prediction with Sparse Annotations
Depth estimation aims to predict dense depth maps. In autonomous driving scenes, sparsity of annotations makes the task challenging. Supervised models produce concave objects due to insufficient structural information. They overfit to valid pixels and fail to restore spatial structures. Self-supervised methods are proposed for the problem. Their robustness is limited by pose estimation, leading to erroneous results in natural scenes. In this paper, we propose a supervised framework termed Diffusion-Augmented Depth Prediction (DADP). We leverage the structural characteristics of diffusion model to enforce depth structures of depth models in a plug-and-play manner. An object-guided integrality loss is also proposed to further enhance regional structure integrality by fetching objective information. We evaluate DADP on three driving benchmarks and achieve significant improvements in depth structures and robustness. Our work provides a new perspective on depth estimation with sparse annotations in autonomous driving scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDepth EstimationDepth PredictionPose EstimationPredictionvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EndoDDC: Learning Sparse to Dense Reconstruction for Endoscopic Robotic Navigation via Diffusion Depth Completion
Accurate depth estimation plays a critical role in the navigation of endoscopic surgical robots, forming the foundation for 3D reconstruction and safe instrument guidance. Fine-tuning pretrained models heavily relies on …
3D ReconstructionDepth EstimationDepth CompletionTHFM: A Unified Video Foundation Model for 4D Human Perception and Beyond
We present THFM, a unified video foundation model for human-centric perception that jointly addresses dense tasks (depth, normals, segmentation, dense pose) and sparse tasks (2d/3d keypoint estimation) within a single ar…
Estimating Image Depth in the Comics Domain
Estimating the depth of comics images is challenging as such images a) are monocular; b) lack ground-truth depth annotations; c) differ across different artistic styles; d) are sparse and noisy. We thus, use an off-the-s…
Depth EstimationDepth PredictionImage-to-Image TranslationTranslation+1Edge-aware Bidirectional Diffusion for Dense Depth Estimation from Light Fields
We present an algorithm to estimate fast and accurate depth maps from light fields via a sparse set of depth edges and gradients. Our proposed approach is based around the idea that true depth edges are more sensitive th…
Depth EstimationSparse Depth Completion with Semantic Mesh Deformation Optimization
Sparse depth measurements are widely available in many applications such as augmented reality, visual inertial odometry and robots equipped with low cost depth sensors. Although such sparse depth samples work well for ce…
3D Object Recognition3D ReconstructionAutonomous DrivingDepth Completion+3