Spacetime Surface Regularization for Neural Dynamic Scene Reconstruction
We propose an algorithm, 4DRegSDF, for the spacetime surface regularization to improve the fidelity of neural rendering and reconstruction in dynamic scenes. The key idea is to impose local rigidity on the deformable Signed Distance Function (SDF) for temporal coherency. Our approach works by (1) sampling points on the deformed surface by taking gradient steps toward the steepest direction along SDF, (2) extracting differential surface geometry, such as tangent plane or curvature, at each sample, and (3) adjusting the local rigidity at different timestamps. This enables our dynamic surface regularization to align 4D spacetime geometry via 3D canonical space more accurately. Experiments demonstrate that our 4DRegSDF achieves state-of-the-art performance in both reconstruction and rendering quality over synthetic and real-world datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural RenderingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SMORE: Simultaneous Map and Object REconstruction
We present a method for dynamic surface reconstruction of large-scale urban scenes from LiDAR. Depth-based reconstructions tend to focus on small-scale objects or large-scale SLAM reconstructions that treat moving object…
Depth CompletionDynamic Reconstructionglobal-optimizationMotion Compensation+4\textit{4DSurf}: High-Fidelity Dynamic Scene Surface Reconstruction
This paper addresses the problem of dynamic scene surface reconstruction using Gaussian Splatting (GS), aiming to recover temporally consistent geometry. While existing GS-based dynamic surface reconstruction methods can…
Photogeometric Scene Flow for High-Detail Dynamic 3D Reconstruction
Photometric stereo (PS) is an established technique for high-detail reconstruction of 3D geometry and appearance. To correct for surface integration errors, PS is often combined with multiview stereo (MVS). With dynamic …
3D geometry3D ReconstructionOptical Flow EstimationVocal Bursts Intensity PredictionCritical Regularizations for Neural Surface Reconstruction in the Wild
Neural implicit functions have recently shown promising results on surface reconstructions from multiple views. However, current methods still suffer from excessive time complexity and poor robustness when reconstructing…
Surface ReconstructionSpacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis
Novel view synthesis of dynamic scenes has been an intriguing yet challenging problem. Despite recent advancements, simultaneously achieving high-resolution photorealistic results, real-time rendering, and compact storag…
8kFeature SplattingGPUNovel View Synthesis