paper-with-me

Papers

DVD: Deterministic Video Depth Estimation with Generative Priors

2026-03-12 · Hongfei Zhang, Harold Haodong Chen, Chenfei Liao, Jing He, Zixin Zhang, Haodong Li, Yihao Liang, Kanghao Chen, Bin Ren, Xu Zheng, Shuai Yang, Kun Zhou, Yinchuan Li, Nicu Sebe, Ying-Cong Chen arxiv

Existing video depth estimation faces a fundamental trade-off: generative models suffer from stochastic geometric hallucinations and scale drift, while discriminative models demand massive labeled datasets to resolve semantic ambiguities. To break this impasse, we present DVD, the first framework to deterministically adapt pre-trained video diffusion models into single-pass depth regressors. Specifically, DVD features three core designs: (i) repurposing the diffusion timestep as a structural anchor to balance global stability with high-frequency details; (ii) latent manifold rectification (LMR) to mitigate regression-induced over-smoothing, enforcing differential constraints to restore sharp boundaries and coherent motion; and (iii) global affine coherence, an inherent property bounding inter-window divergence, which enables seamless long-video inference without requiring complex temporal alignment. Extensive experiments demonstrate that DVD achieves state-of-the-art zero-shot performance across benchmarks. Furthermore, DVD successfully unlocks the profound geometric priors implicit in video foundation models using 163x less task-specific data than leading baselines. Notably, we fully release our pipeline, providing the whole training suite for SOTA video depth estimation to benefit the open-source community.

📄 PDF Abstract BibTeX arXiv:2603.12250

Code (0)

등록된 구현이 없습니다.

Tasks

Depth Estimation

Similar Papers 제목 키워드 기반

Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation

2026-03-17 · Xinhao Cai, Gensheng Pei, Zeren Sun, Yazhou Yao 외 arxiv

In this paper, we propose \textbf{Iris}, a deterministic framework for Monocular Depth Estimation (MDE) that integrates real-world priors into the diffusion model. Conventional feed-forward methods rely on massive traini…

Monocular Depth Estimation

ICDepth: Taming Video Diffusion Models for Video Depth Estimation via In-Context Conditioning

2026-07-02 · Xuanhua He, Jiaxin Xie, Mingzhe Zheng, Qifeng Chen arxiv

Monocular video depth estimation requires temporal consistency, geometric accuracy, and generalization across diverse scenarios, yet existing methods struggle to achieve all three simultaneously. Discriminative models ex…

Zero-shot GeneralizationDepth Estimation

Depth Any Video with Scalable Synthetic Data

2024-10-14 · Honghui Yang, Di Huang, Wei Yin, Chunhua Shen 외

Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackle…

Depth Estimation

Lotus-2: Advancing Geometric Dense Prediction with Powerful Image Generative Model

2025-11-30 · Jing He, Haodong Li, Mingzhi Sheng, Ying-Cong Chen arxiv

Recovering pixel-wise geometric properties from a single image is fundamentally ill-posed due to appearance ambiguity and non-injective mappings between 2D observations and 3D structures. While discriminative regression …

Monocular Depth EstimationImage Generation

Buffer Anytime: Zero-Shot Video Depth and Normal from Image Priors

2024-11-26 · CVPR 2025 1 · Zhengfei Kuang, Tianyuan Zhang, Kai Zhang, Hao Tan 외

We present Buffer Anytime, a framework for estimation of depth and normal maps (which we call geometric buffers) from video that eliminates the need for paired video--depth and video--normal training data. Instead of rel…

Optical Flow Estimation