paper-with-me

홈 › Papers

Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surface

2023-02-28 · Decai Chen, Haofei Lu, Ingo Feldmann, Oliver Schreer, Peter Eisert

Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is under-constrained and noisy. Other works introduce surface constraints to the implicit neural representation to disentangle the ambiguity of geometry and appearance field for static scene reconstruction. To bridge the gap between rendering dynamic scenes and recovering static surface geometry, we propose a template-free method to reconstruct surface geometry and appearance using neural implicit representations from multi-view videos. We leverage topology-aware deformation and the signed distance field to learn complex dynamic surfaces via differentiable volume rendering without scene-specific prior knowledge like template models. Furthermore, we propose a novel mask-based ray selection strategy to significantly boost the optimization on challenging time-varying regions. Experiments on different multi-view video datasets demonstrate that our method achieves high-fidelity surface reconstruction as well as photorealistic novel view synthesis.

📄 PDF Abstract BibTeX arXiv:2303.00050

Code (0)

등록된 구현이 없습니다.

Tasks

Novel View SynthesisSurface Reconstruction

Similar Papers 제목 키워드 기반

Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fields

2021-04-23 · ICCV 2021 10 · Albert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan 외

Reconstructing dynamic, time-varying scenes with computed tomography (4D-CT) is a challenging and ill-posed problem common to industrial and medical settings. Existing 4D-CT reconstructions are designed for sparse sampli…

CT Reconstruction

Autonomous Implicit Indoor Scene Reconstruction with Frontier Exploration

2024-04-16 · Jing Zeng, Yanxu Li, Jiahao Sun, Qi Ye 외

Implicit neural representations have demonstrated significant promise for 3D scene reconstruction. Recent works have extended their applications to autonomous implicit reconstruction through the Next Best View (NBV) base…

3D Scene ReconstructionIndoor Scene Reconstruction

Uncertainty-Driven Active Vision for Implicit Scene Reconstruction

2022-10-03 · Edward J. Smith, Michal Drozdzal, Derek Nowrouzezahrai, David Meger 외

Multi-view implicit scene reconstruction methods have become increasingly popular due to their ability to represent complex scene details. Recent efforts have been devoted to improving the representation of input informa…

Scene Understanding

VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstruction

2022-12-15 · CVPR 2023 1 · Yufan Ren, Fangjinhua Wang, Tong Zhang, Marc Pollefeys 외

The success of the Neural Radiance Fields (NeRF) in novel view synthesis has inspired researchers to propose neural implicit scene reconstruction. However, most existing neural implicit reconstruction methods optimize pe…

NeRFNovel View Synthesis

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction

2022-06-01 · Zehao Yu, Songyou Peng, Michael Niemeyer, Torsten Sattler 외

In recent years, neural implicit surface reconstruction methods have become popular for multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these approaches tend to produce smoother and mo…

3D ReconstructionMulti-View 3D ReconstructionSurface Reconstruction