paper-with-me

홈 › Papers

NeRF Revisited: Fixing Quadrature Instability in Volume Rendering

2023-10-31 · NeurIPS 2023 11 · Mikaela Angelina Uy, Kiyohiro Nakayama, Guandao Yang, Rahul Krishna Thomas, Leonidas Guibas, Ke Li

Neural radiance fields (NeRF) rely on volume rendering to synthesize novel views. Volume rendering requires evaluating an integral along each ray, which is numerically approximated with a finite sum that corresponds to the exact integral along the ray under piecewise constant volume density. As a consequence, the rendered result is unstable w.r.t. the choice of samples along the ray, a phenomenon that we dub quadrature instability. We propose a mathematically principled solution by reformulating the sample-based rendering equation so that it corresponds to the exact integral under piecewise linear volume density. This simultaneously resolves multiple issues: conflicts between samples along different rays, imprecise hierarchical sampling, and non-differentiability of quantiles of ray termination distances w.r.t. model parameters. We demonstrate several benefits over the classical sample-based rendering equation, such as sharper textures, better geometric reconstruction, and stronger depth supervision. Our proposed formulation can be also be used as a drop-in replacement to the volume rendering equation of existing NeRF-based methods. Our project page can be found at pl-nerf.github.io.

📄 PDF Abstract BibTeX arXiv:2310.20685

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

GL-NeRF: Gauss-Laguerre Quadrature Enables Training-Free NeRF Acceleration

2024-10-19 · Silong Yong, Yaqi Xie, Simon Stepputtis, Katia Sycara

Volume rendering in neural radiance fields is inherently time-consuming due to the large number of MLP calls on the points sampled per ray. Previous works would address this issue by introducing new neural networks or da…

AttributeNeRF

Volumetric Rendering with Baked Quadrature Fields

2023-12-02 · Gopal Sharma, Daniel Rebain, Kwang Moo Yi, Andrea Tagliasacchi

We propose a novel Neural Radiance Field (NeRF) representation for non-opaque scenes that enables fast inference by utilizing textured polygons. Despite the high-quality novel view rendering that NeRF provides, a critica…

NeRF

One is All: Bridging the Gap Between Neural Radiance Fields Architectures with Progressive Volume Distillation

2022-11-29 · Shuangkang Fang, Weixin Xu, Heng Wang, Yi Yang 외

Neural Radiance Fields (NeRF) methods have proved effective as compact, high-quality and versatile representations for 3D scenes, and enable downstream tasks such as editing, retrieval, navigation, etc. Various neural ar…

3D ReconstructionAllNeRFNeural Rendering+1

Kernel Quadrature with Randomly Pivoted Cholesky

2023-09-21 · NeurIPS 2023 11

This paper presents new quadrature rules for functions in a reproducing kernel Hilbert space using nodes drawn by a sampling algorithm known as randomly pivoted Cholesky. The resulting computational procedure compares fa…

Kernel quadrature with randomly pivoted Cholesky

2023-06-06 · Ethan N. Epperly, Elvira Moreno

This paper presents new quadrature rules for functions in a reproducing kernel Hilbert space using nodes drawn by a sampling algorithm known as randomly pivoted Cholesky. The resulting computational procedure compares fa…