Sparse Dynamic 3D Reconstruction From Unsynchronized Videos
We target the sparse 3D reconstruction of dynamic objects observed by multiple unsynchronized video cameras with unknown temporal overlap. To this end, we develop a framework to recover the unknown structure without sequencing information across video sequences. Our proposed compressed sensing framework poses the estimation of 3D structure as the problem of dictionary learning. Moreover, we define our dictionary as the temporally varying 3D structure, while we define local sequencing information in terms of the sparse coefficients describing a locally linear 3D structural interpolation. Our formulation optimizes a biconvex cost function that leverages a compressed sensing formulation and enforces both structural dependency coherence across video streams, as well as motion smoothness across estimates from common video sources. Experimental results demonstrate the effectiveness of our approach in both synthetic data and captured imagery.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Reconstructioncompressed sensingDictionary LearningSimilar Papers 제목 키워드 기반
Sync-NeRF: Generalizing Dynamic NeRFs to Unsynchronized Videos
Recent advancements in 4D scene reconstruction using neural radiance fields (NeRF) have demonstrated the ability to represent dynamic scenes from multi-view videos. However, they fail to reconstruct the dynamic scenes an…
NeRFHumans as a Calibration Pattern: Dynamic 3D Scene Reconstruction from Unsynchronized and Uncalibrated Videos
Recent works on dynamic neural field reconstruction assume input from synchronized multi-view videos with known poses. These input constraints are often unmet in real-world setups, making the approach impractical. We dem…
3D Scene ReconstructionNeRFSpatiotemporal Bundle Adjustment for Dynamic 3D Reconstruction
Bundle adjustment jointly optimizes camera intrinsics and extrinsics and 3D point triangulation to reconstruct a static scene. The triangulation constraint however is invalid for moving points captured in multiple unsync…
3D ReconstructionDynamic ReconstructionDynamic Gaussian Scene Reconstruction from Unsynchronized Videos
Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demon…
Video ReconstructionSpatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild
Bundle adjustment jointly optimizes camera intrinsics and extrinsics and 3D point triangulation to reconstruct a static scene. The triangulation constraint, however, is invalid for moving points captured in multiple unsy…
3D Human Reconstruction