paper-with-me

홈 › Papers

VF-NeRF: Learning Neural Vector Fields for Indoor Scene Reconstruction

2024-08-16 · Albert Gassol Puigjaner, Edoardo Mello Rella, Erik Sandström, Ajad Chhatkuli, Luc van Gool

Implicit surfaces via neural radiance fields (NeRF) have shown surprising accuracy in surface reconstruction. Despite their success in reconstructing richly textured surfaces, existing methods struggle with planar regions with weak textures, which account for the majority of indoor scenes. In this paper, we address indoor dense surface reconstruction by revisiting key aspects of NeRF in order to use the recently proposed Vector Field (VF) as the implicit representation. VF is defined by the unit vector directed to the nearest surface point. It therefore flips direction at the surface and equals to the explicit surface normals. Except for this flip, VF remains constant along planar surfaces and provides a strong inductive bias in representing planar surfaces. Concretely, we develop a novel density-VF relationship and a training scheme that allows us to learn VF via volume rendering By doing this, VF-NeRF can model large planar surfaces and sharp corners accurately. We show that, when depth cues are available, our method further improves and achieves state-of-the-art results in reconstructing indoor scenes and rendering novel views. We extensively evaluate VF-NeRF on indoor datasets and run ablations of its components.

📄 PDF Abstract BibTeX arXiv:2408.08766

Code (1)

albertgassol1/vf-nerf 공식 구현 pytorch

Tasks

Indoor Scene ReconstructionInductive BiasNeRFSurface Reconstruction

Similar Papers 제목 키워드 기반

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

2022-03-21 · CVPR 2022 1 · Xiaoshuai Zhang, Sai Bi, Kalyan Sunkavalli, Hao Su 외

While NeRF has shown great success for neural reconstruction and rendering, its limited MLP capacity and long per-scene optimization times make it challenging to model large-scale indoor scenes. In contrast, classical 3D…

3D ReconstructionNeRF

SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields

2022-12-05 · ICCV 2023 1 · Anh-Quan Cao, Raoul de Charette

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a …

3D Reconstruction3D Scene ReconstructionAutonomous DrivingDepth Estimation+4

NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo

2021-09-02 · ICCV 2021 10 · Yi Wei, Shaohui Liu, Yongming Rao, Wang Zhao 외

In this work, we present a new multi-view depth estimation method that utilizes both conventional reconstruction and learning-based priors over the recently proposed neural radiance fields (NeRF). Unlike existing neural …

Depth EstimationNeRF

SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes

2023-04-18 · CVPR 2023 1 · Yiming Gao, Yan-Pei Cao, Ying Shan

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. Wh…

3D ReconstructionNeRFNovel View Synthesis

Nerflets: Local Radiance Fields for Efficient Structure-Aware 3D Scene Representation from 2D Supervision

2023-03-06 · CVPR 2023 1 · Xiaoshuai Zhang, Abhijit Kundu, Thomas Funkhouser, Leonidas Guibas 외

We address efficient and structure-aware 3D scene representation from images. Nerflets are our key contribution -- a set of local neural radiance fields that together represent a scene. Each nerflet maintains its own spa…

3D Panoptic SegmentationPanoptic SegmentationPosition