paper-with-me

Papers

DELTA: Dense Efficient Long-range 3D Tracking for any video

2024-10-31 · Tuan Duc Ngo, Peiye Zhuang, Chuang Gan, Evangelos Kalogerakis, Sergey Tulyakov, Hsin-Ying Lee, Chaoyang Wang

Tracking dense 3D motion from monocular videos remains challenging, particularly when aiming for pixel-level precision over long sequences. We introduce DELTA, a novel method that efficiently tracks every pixel in 3D space, enabling accurate motion estimation across entire videos. Our approach leverages a joint global-local attention mechanism for reduced-resolution tracking, followed by a transformer-based upsampler to achieve high-resolution predictions. Unlike existing methods, which are limited by computational inefficiency or sparse tracking, DELTA delivers dense 3D tracking at scale, running over 8x faster than previous methods while achieving state-of-the-art accuracy. Furthermore, we explore the impact of depth representation on tracking performance and identify log-depth as the optimal choice. Extensive experiments demonstrate the superiority of DELTA on multiple benchmarks, achieving new state-of-the-art results in both 2D and 3D dense tracking tasks. Our method provides a robust solution for applications requiring fine-grained, long-term motion tracking in 3D space.

📄 PDF Abstract BibTeX arXiv:2410.24211

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Estimation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Global-Local Attention 설명 없음

Similar Papers 제목 키워드 기반

DELTAv2: Accelerating Dense 3D Tracking

2025-08-02 · Tuan Duc Ngo, Ashkan Mirzaei, Guocheng Qian, Hanwen Liang 외 arxiv

We propose a novel algorithm for accelerating dense long-term 3D point tracking in videos. Through analysis of existing state-of-the-art methods, we identify two major computational bottlenecks. First, transformer-based …

Point Tracking

FlowTrack: Revisiting Optical Flow for Long-Range Dense Tracking

2024-01-01 · CVPR 2024 1 · Seokju Cho, Jiahui Huang, Seungryong Kim, Joon-Young Lee

In the domain of video tracking existing methods often grapple with a trade-off between spatial density and temporal range. Current approaches in dense optical flow estimators excel in providing spatially dense track…

Optical Flow Estimation

LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos

2026-05-17 · Chenyi Xu, Yihao Wu, Liqi Yan, Chao Yang 외 arxiv

Recovering a dynamic 3D scene from a long monocular video is crucial for dense geometry, camera motion, and temporal correspondence to remain consistent in a shared coordinate system. Existing methods face two key challe…

Dynamic ReconstructionCamera Pose Estimation

Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation

2026-09-17 · Haocheng Xi, Yiming Xie, Hexu Zhao, Yiwen Zhang 외 hf

Video diffusion models repeatedly process long spatiotemporal token sequences during denoising, making attention a major computational bottleneck. Linear attention offers an appealing alternative and has been widely adop…

Video Generation

Online Dense Point Tracking with Streaming Memory

2025-03-09 · Qiaole Dong, Yanwei Fu

Dense point tracking is a challenging task requiring the continuous tracking of every point in the initial frame throughout a substantial portion of a video, even in the presence of occlusions. Traditional methods use op…

Optical Flow EstimationPoint Tracking