FewShotNeRF: Meta-Learning-based Novel View Synthesis for Rapid Scene-Specific Adaptation
In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization, facilitating rapid adaptation of a Neural Radiance Field (NeRF) to specific scenes. The focus of our meta-learning process is on capturing shared geometry and textures within a category, embedded in the weight initialization. This approach expedites the learning process of NeRFs and leverages recent advancements in positional encodings to reduce the time required for fitting a NeRF to a scene, thereby accelerating the inner loop optimization of meta-learning. Notably, our method enables meta-learning on a large number of 3D scenes to establish a robust 3D prior for various categories. Through extensive evaluations on the Common Objects in 3D open source dataset, we empirically demonstrate the efficacy and potential of meta-learning in generating high-quality novel views of objects.
Code (0)
등록된 구현이 없습니다.
Tasks
Meta-LearningNeRFNovel View SynthesisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
WayveScenes101: A Dataset and Benchmark for Novel View Synthesis in Autonomous Driving
We present WayveScenes101, a dataset designed to help the community advance the state of the art in novel view synthesis that focuses on challenging driving scenes containing many dynamic and deformable elements with cha…
Autonomous DrivingBenchmarkingNovel View SynthesisGS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis
Decoupling the illumination in 3D scenes is crucial for novel view synthesis and relighting. In this paper, we propose a novel method for representing a scene illuminated by a point light using a set of relightable 3D Ga…
Bilevel OptimizationMeta-LearningMulti-Task LearningNovel View SynthesisSparse Input View Synthesis: 3D Representations and Reliable Priors
Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of …
Novel View SynthesisVideo CompressionVideo StabilizationGenerating metamers of human scene understanding
Human vision combines low-resolution "gist" information from the visual periphery with sparse but high-resolution information from fixated locations to construct a coherent understanding of a visual scene. In this paper,…
Scene UnderstandingMetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors
Current visual generation models are capable of producing high-quality content, yet they lack a coherent perception of the spatial structure. Existing generative novel view synthesis methods typically introduce explicit …
Novel View Synthesis