paper-with-me

홈 › Papers

Efficient View Synthesis with Neural Radiance Distribution Field

2023-08-22 · ICCV 2023 1 · Yushuang Wu, Xiao Li, Jinglu Wang, Xiaoguang Han, Shuguang Cui, Yan Lu

Recent work on Neural Radiance Fields (NeRF) has demonstrated significant advances in high-quality view synthesis. A major limitation of NeRF is its low rendering efficiency due to the need for multiple network forwardings to render a single pixel. Existing methods to improve NeRF either reduce the number of required samples or optimize the implementation to accelerate the network forwarding. Despite these efforts, the problem of multiple sampling persists due to the intrinsic representation of radiance fields. In contrast, Neural Light Fields (NeLF) reduce the computation cost of NeRF by querying only one single network forwarding per pixel. To achieve a close visual quality to NeRF, existing NeLF methods require significantly larger network capacities which limits their rendering efficiency in practice. In this work, we propose a new representation called Neural Radiance Distribution Field (NeRDF) that targets efficient view synthesis in real-time. Specifically, we use a small network similar to NeRF while preserving the rendering speed with a single network forwarding per pixel as in NeLF. The key is to model the radiance distribution along each ray with frequency basis and predict frequency weights using the network. Pixel values are then computed via volume rendering on radiance distributions. Experiments show that our proposed method offers a better trade-off among speed, quality, and network size than existing methods: we achieve a ~254x speed-up over NeRF with similar network size, with only a marginal performance decline. Our project page is at yushuang-wu.github.io/NeRDF.

📄 PDF Abstract BibTeX arXiv:2308.11130

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Cross-Guided Optimization of Radiance Fields With Multi-View Image Super-Resolution for High-Resolution Novel View Synthesis

2023-01-01 · CVPR 2023 1 · Youngho Yoon, Kuk-Jin Yoon

Novel View Synthesis (NVS) aims at synthesizing an image from an arbitrary viewpoint using multi-view images and camera poses. Among the methods for NVS, Neural Radiance Fields (NeRF) is capable of NVS for an arbitra…

Image Super-ResolutionNeRFNovel View SynthesisSuper-Resolution

MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes

2023-02-23 · Christian Reiser, Richard Szeliski, Dor Verbin, Pratul P. Srinivasan 외

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale …

SPARF: Large-Scale Learning of 3D Sparse Radiance Fields from Few Input Images

2022-12-18 · Abdullah Hamdi, Bernard Ghanem, Matthias Nießner

Recent advances in Neural Radiance Fields (NeRFs) treat the problem of novel view synthesis as Sparse Radiance Field (SRF) optimization using sparse voxels for efficient and fast rendering (plenoxels,InstantNGP). In orde…

Novel View Synthesis

CeRF: Convolutional Neural Radiance Fields for New View Synthesis with Derivatives of Ray Modeling

2023-07-14 · Xiaoyan Yang, Dingbo Lu, Yang Li, Chenhui Li 외

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still ba…

Neural RenderingNovel View Synthesis

3D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Field

2024-01-26 · Zhenyu Bao, Guibiao Liao, Zhongyuan Zhao, Kanglin Liu 외

Simultaneously achieving 3D reconstruction and new view synthesis for indoor environments has widespread applications but is technically very challenging. State-of-the-art methods based on implicit neural functions can a…

3D ReconstructionNeRFNovel View Synthesis