paper-with-me

Papers

StructNeRF: Neural Radiance Fields for Indoor Scenes with Structural Hints

2022-09-12 · Zheng Chen, Chen Wang, Yuan-Chen Guo, Song-Hai Zhang

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view synthesis quality. Inspired by self-supervised depth estimation methods, we propose StructNeRF, a solution to novel view synthesis for indoor scenes with sparse inputs. StructNeRF leverages the structural hints naturally embedded in multi-view inputs to handle the unconstrained geometry issue in NeRF. Specifically, it tackles the texture and non-texture regions respectively: a patch-based multi-view consistent photometric loss is proposed to constrain the geometry of textured regions; for non-textured ones, we explicitly restrict them to be 3D consistent planes. Through the dense self-supervised depth constraints, our method improves both the geometry and the view synthesis performance of NeRF without any additional training on external data. Extensive experiments on several real-world datasets demonstrate that StructNeRF surpasses state-of-the-art methods for indoor scenes with sparse inputs both quantitatively and qualitatively.

📄 PDF Abstract BibTeX arXiv:2209.05277

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationNeRFNovel View Synthesis

Similar Papers 제목 키워드 기반

360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360$^\circ$ Radiance Fields

2022-08-04 · Huajian Huang, Yingshu Chen, Tianjia Zhang, Sai-Kit Yeung

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel…

NeRFNovel View Synthesis

Unconstrained Scene Generation with Locally Conditioned Radiance Fields

2021-04-01 · ICCV 2021 10 · Terrance DeVries, Miguel Angel Bautista, Nitish Srivastava, Graham W. Taylor 외

We tackle the challenge of learning a distribution over complex, realistic, indoor scenes. In this paper, we introduce Generative Scene Networks (GSN), which learns to decompose scenes into a collection of many local rad…

DiversityScene Generation

NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo

2021-09-02 · ICCV 2021 10 · Yi Wei, Shaohui Liu, Yongming Rao, Wang Zhao 외

In this work, we present a new multi-view depth estimation method that utilizes both conventional reconstruction and learning-based priors over the recently proposed neural radiance fields (NeRF). Unlike existing neural …

Depth EstimationNeRF

MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo

2021-03-29 · ICCV 2021 10 · Anpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang 외

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on dense…

NeRFNeural Rendering

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

2022-03-21 · CVPR 2022 1 · Xiaoshuai Zhang, Sai Bi, Kalyan Sunkavalli, Hao Su 외

While NeRF has shown great success for neural reconstruction and rendering, its limited MLP capacity and long per-scene optimization times make it challenging to model large-scale indoor scenes. In contrast, classical 3D…

3D ReconstructionNeRF