paper-with-me

홈 › Papers

Efficient Ray Sampling for Radiance Fields Reconstruction

2023-08-29 · Shilei Sun, Ming Liu, Zhongyi Fan, Yuxue Liu, Chengwei Lv, Liquan Dong, Lingqin Kong

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training efficiency. We therefore propose a novel ray sampling approach for neural radiance fields that improves training efficiency while retaining photorealistic rendering results. First, we analyze the relationship between the pixel loss distribution of sampled rays and rendering quality. This reveals redundancy in the original NeRF's uniform ray sampling. Guided by this finding, we develop a sampling method leveraging pixel regions and depth boundaries. Our main idea is to sample fewer rays in training views, yet with each ray more informative for scene fitting. Sampling probability increases in pixel areas exhibiting significant color and depth variation, greatly reducing wasteful rays from other regions without sacrificing precision. Through this method, not only can the convergence of the network be accelerated, but the spatial geometry of a scene can also be perceived more accurately. Rendering outputs are enhanced, especially for texture-complex regions. Experiments demonstrate that our method significantly outperforms state-of-the-art techniques on public benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2308.15547

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields

2022-12-05 · ICCV 2023 1 · Anh-Quan Cao, Raoul de Charette

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a …

3D Reconstruction3D Scene ReconstructionAutonomous DrivingDepth Estimation+4

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

2021-04-20 · ICCV 2021 10 · Michael Oechsle, Songyou Peng, Andreas Geiger

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate …

3D Object ReconstructionNeRFNovel View SynthesisSurface Reconstruction

Differentiable Rendering with Reparameterized Volume Sampling

2023-02-21 · Nikita Morozov, Denis Rakitin, Oleg Desheulin, Dmitry Vetrov 외

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes…

NeRFNovel View Synthesis

Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields

2023-07-21 · ICCV 2023 1 · WenBo Hu, Yuling Wang, Lin Ma, Bangbang Yang 외

Despite the tremendous progress in neural radiance fields (NeRF), we still face a dilemma of the trade-off between quality and efficiency, e.g., MipNeRF presents fine-detailed and anti-aliased renderings but takes days f…

NeRF

Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields

2024-03-24 · CVPR 2024 1 · Haoyuan Wang, WenBo Hu, Lei Zhu, Rynson W. H. Lau

Inverse rendering aims at recovering both geometry and materials of objects. It provides a more compatible reconstruction for conventional rendering engines, compared with the neural radiance fields (NeRFs). On the other…

Inverse RenderingNeRFObject