Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surface
Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is under-constrained and noisy. Other works introduce surface constraints to the implicit neural representation to disentangle the ambiguity of geometry and appearance field for static scene reconstruction. To bridge the gap between rendering dynamic scenes and recovering static surface geometry, we propose a template-free method to reconstruct surface geometry and appearance using neural implicit representations from multi-view videos. We leverage topology-aware deformation and the signed distance field to learn complex dynamic surfaces via differentiable volume rendering without scene-specific prior knowledge like template models. Furthermore, we propose a novel mask-based ray selection strategy to significantly boost the optimization on challenging time-varying regions. Experiments on different multi-view video datasets demonstrate that our method achieves high-fidelity surface reconstruction as well as photorealistic novel view synthesis.
Code (0)
등록된 구현이 없습니다.
Tasks
Novel View SynthesisSurface ReconstructionSimilar Papers 제목 키워드 기반
Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fields
Reconstructing dynamic, time-varying scenes with computed tomography (4D-CT) is a challenging and ill-posed problem common to industrial and medical settings. Existing 4D-CT reconstructions are designed for sparse sampli…
CT ReconstructionAutonomous Implicit Indoor Scene Reconstruction with Frontier Exploration
Implicit neural representations have demonstrated significant promise for 3D scene reconstruction. Recent works have extended their applications to autonomous implicit reconstruction through the Next Best View (NBV) base…
3D Scene ReconstructionIndoor Scene ReconstructionUncertainty-Driven Active Vision for Implicit Scene Reconstruction
Multi-view implicit scene reconstruction methods have become increasingly popular due to their ability to represent complex scene details. Recent efforts have been devoted to improving the representation of input informa…
Scene UnderstandingVolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction
The success of the Neural Radiance Fields (NeRF) in novel view synthesis has inspired researchers to propose neural implicit scene reconstruction. However, most existing neural implicit reconstruction methods optimize pe…
NeRFNovel View SynthesisMonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction
In recent years, neural implicit surface reconstruction methods have become popular for multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these approaches tend to produce smoother and mo…
3D ReconstructionMulti-View 3D ReconstructionSurface Reconstruction