paper-with-me

홈 › Papers

CombiNeRF: A Combination of Regularization Techniques for Few-Shot Neural Radiance Field View Synthesis

2024-03-21 · Matteo Bonotto, Luigi Sarrocco, Daniele Evangelista, Marco Imperoli, Alberto Pretto

Neural Radiance Fields (NeRFs) have shown impressive results for novel view synthesis when a sufficiently large amount of views are available. When dealing with few-shot settings, i.e. with a small set of input views, the training could overfit those views, leading to artifacts and geometric and chromatic inconsistencies in the resulting rendering. Regularization is a valid solution that helps NeRF generalization. On the other hand, each of the most recent NeRF regularization techniques aim to mitigate a specific rendering problem. Starting from this observation, in this paper we propose CombiNeRF, a framework that synergically combines several regularization techniques, some of them novel, in order to unify the benefits of each. In particular, we regularize single and neighboring rays distributions and we add a smoothness term to regularize near geometries. After these geometric approaches, we propose to exploit Lipschitz regularization to both NeRF density and color networks and to use encoding masks for input features regularization. We show that CombiNeRF outperforms the state-of-the-art methods with few-shot settings in several publicly available datasets. We also present an ablation study on the LLFF and NeRF-Synthetic datasets that support the choices made. We release with this paper the open-source implementation of our framework.

📄 PDF Abstract BibTeX arXiv:2403.14412

Code (1)

sarroccoluigi/combinerf 공식 구현 pytorch

Tasks

NeRFNovel View Synthesisvalid

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Self-NeRF: A Self-Training Pipeline for Few-Shot Neural Radiance Fields

2023-03-10 · Jiayang Bai, Letian Huang, Wen Gong, Jie Guo 외

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrate…

NeRF

GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistency

2023-01-26 · Min-Seop Kwak, Jiuhn Song, Seungryong Kim

We present a novel framework to regularize Neural Radiance Field (NeRF) in a few-shot setting with a geometry-aware consistency regularization. The proposed approach leverages a rendered depth map at unobserved viewpoint…

NeRF

Few-shot NeRF by Adaptive Rendering Loss Regularization

2024-10-23 · Qingshan Xu, Xuanyu Yi, Jianyao Xu, Wenbing Tao 외

Novel view synthesis with sparse inputs poses great challenges to Neural Radiance Field (NeRF). Recent works demonstrate that the frequency regularization of Positional Encoding (PE) can achieve promising results for few…

NeRFNovel View Synthesis

Self-Evolving Neural Radiance Fields

2023-12-02 · Jaewoo Jung, Jisang Han, Jiwon Kang, Seongchan Kim 외

Recently, neural radiance field (NeRF) has shown remarkable performance in novel view synthesis and 3D reconstruction. However, it still requires abundant high-quality images, limiting its applicability in real-world sce…

3D ReconstructionNeRFNovel View Synthesis

FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization

2023-03-13 · CVPR 2023 1 · Jiawei Yang, Marco Pavone, Yue Wang

Novel view synthesis with sparse inputs is a challenging problem for neural radiance fields (NeRF). Recent efforts alleviate this challenge by introducing external supervision, such as pre-trained models and extra depth …

NeRFNeural RenderingNovel View Synthesis