paper-with-me

홈 › Papers

Seurat: From Moving Points to Depth

2025-04-20 · CVPR 2025 1 · Seokju Cho, Jiahui Huang, Seungryong Kim, Joon-Young Lee

Accurate depth estimation from monocular videos remains challenging due to ambiguities inherent in single-view geometry, as crucial depth cues like stereopsis are absent. However, humans often perceive relative depth intuitively by observing variations in the size and spacing of objects as they move. Inspired by this, we propose a novel method that infers relative depth by examining the spatial relationships and temporal evolution of a set of tracked 2D trajectories. Specifically, we use off-the-shelf point tracking models to capture 2D trajectories. Then, our approach employs spatial and temporal transformers to process these trajectories and directly infer depth changes over time. Evaluated on the TAPVid-3D benchmark, our method demonstrates robust zero-shot performance, generalizing effectively from synthetic to real-world datasets. Results indicate that our approach achieves temporally smooth, high-accuracy depth predictions across diverse domains.

📄 PDF Abstract BibTeX arXiv:2504.14687

Code (1)

cvlab-kaist/seurat 공식 구현

Tasks

Depth EstimationPoint Tracking

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Subject clustering by IF-PCA and several recent methods

2023-06-08 · Dieyi Chen, Jiashun Jin, Zheng Tracy Ke

Subject clustering (i.e., the use of measured features to cluster subjects, such as patients or cells, into multiple groups) is a problem of great interest. In recent years, many approaches were proposed, among which uns…

Clustering

Consistent Depth of Moving Objects in Video

2021-08-02 · Zhoutong Zhang, Forrester Cole, Richard Tucker, William T. Freeman 외

We present a method to estimate depth of a dynamic scene, containing arbitrary moving objects, from an ordinary video captured with a moving camera. We seek a geometrically and temporally consistent solution to this unde…

Depth EstimationDepth PredictionPredictionRolling Shutter Correction+1

From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Prior

2023-12-15 · CVPR 2024 1 · Jaeho Moon, Juan Luis Gonzalez Bello, Byeongjun Kwon, Munchurl Kim

Self-supervised monocular depth estimation (DE) is an approach to learning depth without costly depth ground truths. However, it often struggles with moving objects that violate the static scene assumption during trainin…

Depth EstimationMonocular Depth Estimation

Self-Annotated 3D Geometric Learning for Smeared Points Removal

2023-11-15 · Miaowei Wang, Daniel Morris

There has been significant progress in improving the accuracy and quality of consumer-level dense depth sensors. Nevertheless, there remains a common depth pixel artifact which we call smeared points. These are points no…

valid

Attentional Separation-and-Aggregation Network for Self-supervised Depth-Pose Learning in Dynamic Scenes

2020-11-18 · Feng Gao, Jincheng Yu, Hao Shen, Yu Wang 외

Learning depth and ego-motion from unlabeled videos via self-supervision from epipolar projection can improve the robustness and accuracy of the 3D perception and localization of vision-based robots. However, the rigid p…