paper-with-me

홈 › Papers

DynamicVGGT: Learning Dynamic Point Maps for 4D Scene Reconstruction in Autonomous Driving

2026-03-09 · Zhuolin He, Jing Li, Guanghao Li, Xiaolei Chen, Jiacheng Tang, Siyang Zhang, Zhounan Jin, Feipeng Cai, Bin Li, Jian Pu, Jia Cai, Xiangyang Xue arxiv

Dynamic scene reconstruction in autonomous driving remains a fundamental challenge due to significant temporal variations, moving objects, and complex scene dynamics. Existing feed-forward 3D models have demonstrated strong performance in static reconstruction but still struggle to capture dynamic motion. To address these limitations, we propose DynamicVGGT, a unified feed-forward framework that extends VGGT from static 3D perception to dynamic 4D reconstruction. Our goal is to model point motion within feed-forward 3D models in a dynamic and temporally coherent manner. To this end, we jointly predict the current and future point maps within a shared reference coordinate system, allowing the model to implicitly learn dynamic point representations through temporal correspondence. To efficiently capture temporal dependencies, we introduce a Motion-aware Temporal Attention (MTA) module that learns motion continuity. Furthermore, we design a Dynamic 3D Gaussian Splatting Head that explicitly models point motion by predicting Gaussian velocities using learnable motion tokens under scene flow supervision. It refines dynamic geometry through continuous 3D Gaussian optimization. Extensive experiments on autonomous driving datasets demonstrate that DynamicVGGT significantly outperforms existing methods in reconstruction accuracy, achieving robust feed-forward 4D dynamic scene reconstruction under complex driving scenarios.

📄 PDF Abstract BibTeX arXiv:2603.08254

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

D^2USt3R: Enhancing 3D Reconstruction with 4D Pointmaps for Dynamic Scenes

2025-04-08 · Jisang Han, Honggyu An, Jaewoo Jung, Takuya Narihira 외

We address the task of 3D reconstruction in dynamic scenes, where object motions degrade the quality of previous 3D pointmap regression methods, such as DUSt3R, originally designed for static 3D scene reconstruction. Alt…

3D Reconstruction3D Scene Reconstruction

V-DPM: 4D Video Reconstruction with Dynamic Point Maps

2026-01-14 · Edgar Sucar, Eldar Insafutdinov, Zihang Lai, Andrea Vedaldi arxiv

Powerful 3D representations such as DUSt3R invariant point maps, which encode 3D shape and camera parameters, have significantly advanced feed forward 3D reconstruction. While point maps assume static scenes, Dynamic Poi…

Video Reconstruction3D Reconstruction

Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstruction

2025-03-20 · Edgar Sucar, Zihang Lai, Eldar Insafutdinov, Andrea Vedaldi

DUSt3R has recently shown that one can reduce many tasks in multi-view geometry, including estimating camera intrinsics and extrinsics, reconstructing the scene in 3D, and establishing image correspondences, to the predi…

3D Object Tracking3D ReconstructionDepth EstimationDepth Prediction+5

Driv3R: Learning Dense 4D Reconstruction for Autonomous Driving

2024-12-09 · Xin Fei, Wenzhao Zheng, Yueqi Duan, Wei Zhan 외

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In thi…

4D reconstructionAutonomous DrivingDepth EstimationSensor Fusion

Continuous 3D Perception Model with Persistent State

2025-01-21 · CVPR 2025 1 · Qianqian Wang, Yifei Zhang, Aleksander Holynski, Alexei A. Efros 외

We present a unified framework capable of solving a broad range of 3D tasks. Our approach features a stateful recurrent model that continuously updates its state representation with each new observation. Given a stream o…

3D Reconstructionmodel