RefinedFields: Radiance Fields Refinement for Unconstrained Scenes
Modeling large scenes from unconstrained images has proven to be a major challenge in computer vision. Existing methods tackling in-the-wild scene modeling operate in closed-world settings, where no conditioning on priors acquired from real-world images is present. We propose RefinedFields, which is, to the best of our knowledge, the first method leveraging pre-trained models to improve in-the-wild scene modeling. We employ pre-trained networks to refine K-Planes representations via optimization guidance using an alternating training procedure. We carry out extensive experiments and verify the merit of our method on synthetic data and real tourism photo collections. RefinedFields enhances rendered scenes with richer details and improves upon its base representation on the task of novel view synthesis in the wild. Our project page can be found at https://refinedfields.github.io.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural RenderingNovel View SynthesisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unconstrained Scene Generation with Locally Conditioned Radiance Fields
We tackle the challenge of learning a distribution over complex, realistic, indoor scenes. In this paper, we introduce Generative Scene Networks (GSN), which learns to decompose scenes into a collection of many local rad…
DiversityScene GenerationStructNeRF: Neural Radiance Fields for Indoor Scenes with Structural Hints
Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradati…
Depth EstimationNeRFNovel View SynthesisNeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections
We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a mul…
NeRFHAL-NeRF: High Accuracy Localization Leveraging Neural Radiance Fields
Precise camera localization is a critical task in XR applications and robotics. Using only the camera captures as input to a system is an inexpensive option that enables localization in large indoor and outdoor environme…
Camera LocalizationCamera RelocalizationNeRFTranslationAnimatable Neural Radiance Fields from Monocular RGB Videos
We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via i…
3D Human ReconstructionNeRFNeural RenderingNovel View Synthesis+1