paper-with-me

홈 › Papers

Exact-NeRF: An Exploration of a Precise Volumetric Parameterization for Neural Radiance Fields

2022-11-22 · CVPR 2023 1 · Brian K. S. Isaac-Medina, Chris G. Willcocks, Toby P. Breckon

Neural Radiance Fields (NeRF) have attracted significant attention due to their ability to synthesize novel scene views with great accuracy. However, inherent to their underlying formulation, the sampling of points along a ray with zero width may result in ambiguous representations that lead to further rendering artifacts such as aliasing in the final scene. To address this issue, the recent variant mip-NeRF proposes an Integrated Positional Encoding (IPE) based on a conical view frustum. Although this is expressed with an integral formulation, mip-NeRF instead approximates this integral as the expected value of a multivariate Gaussian distribution. This approximation is reliable for short frustums but degrades with highly elongated regions, which arises when dealing with distant scene objects under a larger depth of field. In this paper, we explore the use of an exact approach for calculating the IPE by using a pyramid-based integral formulation instead of an approximated conical-based one. We denote this formulation as Exact-NeRF and contribute the first approach to offer a precise analytical solution to the IPE within the NeRF domain. Our exploratory work illustrates that such an exact formulation Exact-NeRF matches the accuracy of mip-NeRF and furthermore provides a natural extension to more challenging scenarios without further modification, such as in the case of unbounded scenes. Our contribution aims to both address the hitherto unexplored issues of frustum approximation in earlier NeRF work and additionally provide insight into the potential future consideration of analytical solutions in future NeRF extensions.

📄 PDF Abstract BibTeX arXiv:2211.12285

Code (1)

kostadinovshalon/exact-nerf 공식 구현 jax

Tasks

NeRF

Similar Papers 제목 키워드 기반

Rate-aware Compression for NeRF-based Volumetric Video

2024-11-08 · ZhiYu Zhang, Guo Lu, Huanxiong Liang, Zhengxue Cheng 외

The neural radiance fields (NeRF) have advanced the development of 3D volumetric video technology, but the large data volumes they involve pose significant challenges for storage and transmission. To address these proble…

NeRFQuantization

Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields

2021-12-07 · CVPR 2022 1 · Dor Verbin, Peter Hedman, Ben Mildenhall, Todd Zickler 외

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent …

NeRF

A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Pose

2021-02-11 · NeurIPS 2021 12 · Shih-Yang Su, Frank Yu, Michael Zollhoefer, Helge Rhodin

While deep learning reshaped the classical motion capture pipeline with feed-forward networks, generative models are required to recover fine alignment via iterative refinement. Unfortunately, the existing models are usu…

NeRFNeural RenderingNovel View SynthesisPose Estimation

EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesis

2024-10-02 · Alexander Mai, Peter Hedman, George Kopanas, Dor Verbin 외

We present Exact Volumetric Ellipsoid Rendering (EVER), a method for real-time differentiable emission-only volume rendering. Unlike recent rasterization based approach by 3D Gaussian Splatting (3DGS), our primitive base…

3DGSNeRFNovel View Synthesis

Learning Neural Volumetric Representations of Dynamic Humans in Minutes

2023-02-23 · CVPR 2023 1 · Chen Geng, Sida Peng, Zhen Xu, Hujun Bao 외

This paper addresses the challenge of quickly reconstructing free-viewpoint videos of dynamic humans from sparse multi-view videos. Some recent works represent the dynamic human as a canonical neural radiance field (NeRF…

GPUNeRF