COLMAP-Free 3D Gaussian Splatting
While neural rendering has led to impressive advances in scene reconstruction and novel view synthesis, it relies heavily on accurately pre-computed camera poses. To relax this constraint, multiple efforts have been made to train Neural Radiance Fields (NeRFs) without pre-processed camera poses. However, the implicit representations of NeRFs provide extra challenges to optimize the 3D structure and camera poses at the same time. On the other hand, the recently proposed 3D Gaussian Splatting provides new opportunities given its explicit point cloud representations. This paper leverages both the explicit geometric representation and the continuity of the input video stream to perform novel view synthesis without any SfM preprocessing. We process the input frames in a sequential manner and progressively grow the 3D Gaussians set by taking one input frame at a time, without the need to pre-compute the camera poses. Our method significantly improves over previous approaches in view synthesis and camera pose estimation under large motion changes. Our project page is https://oasisyang.github.io/colmap-free-3dgs
Code (1)
Tasks
3DGSCamera Pose EstimationNeural RenderingNovel View SynthesisPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations
COLMAP-free 3D Gaussian Splatting (3D-GS) has recently attracted increasing attention due to its remarkable performance in reconstructing high-quality 3D scenes from unposed images or videos. However, it often struggles …
Camera Pose EstimationJOGS: Joint Optimization of Pose Estimation and 3D Gaussian Splatting
Traditional novel view synthesis methods heavily rely on external camera pose estimation tools such as COLMAP, which often introduce computational bottlenecks and propagate errors. To address these challenges, we propose…
Camera Pose EstimationNovel View SynthesisGloSplat: Joint Pose-Appearance Optimization for Faster and More Accurate 3D Reconstruction
Feature extraction, matching, structure from motion (SfM), and novel view synthesis (NVS) have traditionally been treated as separate problems with independent optimization objectives. We present GloSplat, a framework th…
Novel View Synthesis3D ReconstructionInstantSplat: Sparse-view SfM-free Gaussian Splatting in Seconds
While neural 3D reconstruction has advanced substantially, it typically requires densely captured multi-view data with carefully initialized poses (e.g., using COLMAP). However, this requirement limits its broader applic…
3D ReconstructionNovel View SynthesisSSIMEnhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
Recent advancements in zero-shot video diffusion models have shown promise for text-driven video editing, but challenges remain in achieving high temporal consistency. To address this, we introduce Video-3DGS, a 3D Gauss…
3DGSNeRFVideo EditingVideo Reconstruction