PARF: Primitive-Aware Radiance Fusion for Indoor Scene Novel View Synthesis
This paper proposes a method for fast scene radiance field reconstruction with strong novel view synthesis performance and convenient scene editing functionality. The key idea is to fully utilize semantic parsing and primitive extraction for constraining and accelerating the radiance field reconstruction process. To fulfill this goal, a primitive-aware hybrid rendering strategy was proposed to enjoy the best of both volumetric and primitive rendering. We further contribute a reconstruction pipeline conducts primitive parsing and radiance field learning iteratively for each input frame which successfully fuses semantic, primitive, and radiance information into a single framework. Extensive evaluations demonstrate the fast reconstruction ability, high rendering quality, and convenient editing functionality of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Novel View SynthesisSemantic ParsingSimilar Papers 제목 키워드 기반
SPARF: Large-Scale Learning of 3D Sparse Radiance Fields from Few Input Images
Recent advances in Neural Radiance Fields (NeRFs) treat the problem of novel view synthesis as Sparse Radiance Field (SRF) optimization using sparse voxels for efficient and fast rendering (plenoxels,InstantNGP). In orde…
Novel View SynthesisSPARF: Neural Radiance Fields from Sparse and Noisy Poses
Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highl…
NeRFNovel View Synthesis360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360$^\circ$ Radiance Fields
Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel…
NeRFNovel View SynthesisTransHuman: A Transformer-based Human Representation for Generalizable Neural Human Rendering
In this paper, we focus on the task of generalizable neural human rendering which trains conditional Neural Radiance Fields (NeRF) from multi-view videos of different characters. To handle the dynamic human motion, previ…
NeRFTag-Aware Ordinal Sparse Factor Analysis for Learning and Content Analytics
Machine learning offers novel ways and means to design personalized learning systems wherein each student's educational experience is customized in real time depending on their background, learning goals, and performance…
BIG-bench Machine LearningCollaborative FilteringTAG