Fast and Explicit Neural View Synthesis
We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view synthesis. Our approach explicitly encodes observations into a volumetric representation that enables amortized rendering. We demonstrate that although continuous radiance field representations have gained a lot of attention due to their expressive power, our simple approach obtains comparable or even better novel view reconstruction quality comparing with state-of-the-art baselines while increasing rendering speed by over 400x. Our model is trained in a category-agnostic manner and does not require scene-specific optimization. Therefore, it is able to generalize novel view synthesis to object categories not seen during training. In addition, we show that with our simple formulation, we can use view synthesis as a self-supervision signal for efficient learning of 3D geometry without explicit 3D supervision.
Code (0)
등록된 구현이 없습니다.
Tasks
3D geometryNovel View SynthesisSimilar Papers 제목 키워드 기반
Factorized Motion Fields for Fast Sparse Input Dynamic View Synthesis
Designing a 3D representation of a dynamic scene for fast optimization and rendering is a challenging task. While recent explicit representations enable fast learning and rendering of dynamic radiance fields, they requir…
Cascaded and Generalizable Neural Radiance Fields for Fast View Synthesis
We present CG-NeRF, a cascade and generalizable neural radiance fields method for view synthesis. Recent generalizing view synthesis methods can render high-quality novel views using a set of nearby input views. However,…
GPUNeRFNeural RenderingNovel View SynthesisBridging Implicit and Explicit Geometric Transformation for Single-Image View Synthesis
Creating novel views from a single image has achieved tremendous strides with advanced autoregressive models, as unseen regions have to be inferred from the visible scene contents. Although recent methods generate high-q…
3D geometryDepth-Guided Robust and Fast Point Cloud Fusion NeRF for Sparse Input Views
Novel-view synthesis with sparse input views is important for real-world applications like AR/VR and autonomous driving. Recent methods have integrated depth information into NeRFs for sparse input synthesis, leveraging …
Autonomous DrivingNeRFNovel View SynthesisFWD: Real-time Novel View Synthesis with Forward Warping and Depth
Novel view synthesis (NVS) is a challenging task requiring systems to generate photorealistic images of scenes from new viewpoints, where both quality and speed are important for applications. Previous image-based render…
NeRFNovel View Synthesis