paper-with-me

홈 › Papers

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

2021-04-20 · ICCV 2021 10 · Michael Oechsle, Songyou Peng, Andreas Geiger

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object masks as supervision. At the same time, neural radiance fields have revolutionized novel view synthesis. However, NeRF's estimated volume density does not admit accurate surface reconstruction. Our key insight is that implicit surface models and radiance fields can be formulated in a unified way, enabling both surface and volume rendering using the same model. This unified perspective enables novel, more efficient sampling procedures and the ability to reconstruct accurate surfaces without input masks. We compare our method on the DTU, BlendedMVS, and a synthetic indoor dataset. Our experiments demonstrate that we outperform NeRF in terms of reconstruction quality while performing on par with IDR without requiring masks.

📄 PDF Abstract BibTeX arXiv:2104.10078

Code (2)

autonomousvision/unisurf 공식 구현 pytorch
ventusff/neurecon pytorch

Tasks

3D Object ReconstructionNeRFNovel View SynthesisSurface Reconstruction

Similar Papers 제목 키워드 기반

Learning Neural Implicit Surfaces with Object-Aware Radiance Fields

2023-01-01 · ICCV 2023 1 · Yiheng Zhang, Zhaofan Qiu, Yingwei Pan, Ting Yao 외

Recent progress on multi-view 3D object reconstruction has featured neural implicit surfaces via learning high-fidelity radiance fields. However, most approaches hinge on the visual hull derived from cost-expensive s…

3D Object ReconstructionObjectObject Reconstruction

Level-S$^2$fM: Structure from Motion on Neural Level Set of Implicit Surfaces

2022-11-22 · CVPR 2023 1 · Yuxi Xiao, Nan Xue, Tianfu Wu, Gui-Song Xia

This paper presents a neural incremental Structure-from-Motion (SfM) approach, Level-S$^2$fM, which estimates the camera poses and scene geometry from a set of uncalibrated images by learning coordinate MLPs for the impl…

3D ReconstructionCamera Pose EstimationNeural RenderingPose Estimation

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

2021-11-01 · NeurIPS 2021 12 · Xudong Xu, Xingang Pan, Dahua Lin, Bo Dai

The advent of generative radiance fields has significantly promoted the development of 3D-aware image synthesis. The cumulative rendering process in radiance fields makes training these generative models much easier sinc…

3D-Aware Image SynthesisImage GenerationObject

TIFace: Improving Facial Reconstruction through Tensorial Radiance Fields and Implicit Surfaces

2023-12-15 · Ruijie Zhu, Jiahao Chang, Ziyang Song, Jiahuan Yu 외

This report describes the solution that secured the first place in the "View Synthesis Challenge for Human Heads (VSCHH)" at the ICCV 2023 workshop. Given the sparse view images of human heads, the objective of this chal…

Face ReconstructionNeural RenderingNovel View Synthesis

NLOS-NeuS: Non-line-of-sight Neural Implicit Surface

2023-03-22 · ICCV 2023 1 · Yuki Fujimura, Takahiro Kushida, Takuya Funatomi, Yasuhiro Mukaigawa

Non-line-of-sight (NLOS) imaging is conducted to infer invisible scenes from indirect light on visible objects. The neural transient field (NeTF) was proposed for representing scenes as neural radiance fields in NLOS sce…