paper-with-me

홈 › Papers

Optimize the Unseen - Fast NeRF Cleanup with Free Space Prior

2024-12-17 · Leo Segre, Shai Avidan

Neural Radiance Fields (NeRF) have advanced photorealistic novel view synthesis, but their reliance on photometric reconstruction introduces artifacts, commonly known as "floaters". These artifacts degrade novel view quality, especially in areas unseen by the training cameras. We present a fast, post-hoc NeRF cleanup method that eliminates such artifacts by enforcing our Free Space Prior, effectively minimizing floaters without disrupting the NeRF's representation of observed regions. Unlike existing approaches that rely on either Maximum Likelihood (ML) estimation to fit the data or a complex, local data-driven prior, our method adopts a Maximum-a-Posteriori (MAP) approach, selecting the optimal model parameters under a simple global prior assumption that unseen regions should remain empty. This enables our method to clean artifacts in both seen and unseen areas, enhancing novel view quality even in challenging scene regions. Our method is comparable with existing NeRF cleanup models while being 2.5x faster in inference time, requires no additional memory beyond the original NeRF, and achieves cleanup training in less than 30 seconds. Our code will be made publically available.

📄 PDF Abstract BibTeX arXiv:2412.12772

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFNovel View Synthesis

Similar Papers 제목 키워드 기반

F$^{2}$-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories

2023-03-28 · Peng Wang, YuAn Liu, Zhaoxi Chen, Lingjie Liu 외

This paper presents a novel grid-based NeRF called F2-NeRF (Fast-Free-NeRF) for novel view synthesis, which enables arbitrary input camera trajectories and only costs a few minutes for training. Existing fast grid-based …

NeRFNovel View Synthesis

F2-NeRF: Fast Neural Radiance Field Training With Free Camera Trajectories

2023-01-01 · CVPR 2023 1 · Peng Wang, YuAn Liu, Zhaoxi Chen, Lingjie Liu 외

This paper presents a novel grid-based NeRF called F^2-NeRF (Fast-Free-NeRF) for novel view synthesis, which enables arbitrary input camera trajectories and only costs a few minutes for training. Existing fast grid-b…

NeRFNovel View Synthesis

FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views

2023-03-25 · CVPR 2023 1 · Vinoj Jayasundara, Amit Agrawal, Nicolas Heron, Abhinav Shrivastava 외

We present FlexNeRF, a method for photorealistic freeviewpoint rendering of humans in motion from monocular videos. Our approach works well with sparse views, which is a challenging scenario when the subject is exhibitin…

Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time

2022-02-17 · CVPR 2022 1 · Liao Wang, Jiakai Zhang, Xinhang Liu, Fuqiang Zhao 외

Implicit neural representations such as Neural Radiance Field (NeRF) have focused mainly on modeling static objects captured under multi-view settings where real-time rendering can be achieved with smart data structures,…

NeRF

MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videos

2022-12-26 · ICCV 2023 1 · Fengrui Tian, Shaoyi Du, Yueqi Duan

In this paper, we target at the problem of learning a generalizable dynamic radiance field from monocular videos. Different from most existing NeRF methods that are based on multiple views, monocular videos only contain …

NeRF