paper-with-me

홈 › Papers

Volumetric Rendering with Baked Quadrature Fields

2023-12-02 · Gopal Sharma, Daniel Rebain, Kwang Moo Yi, Andrea Tagliasacchi

We propose a novel Neural Radiance Field (NeRF) representation for non-opaque scenes that enables fast inference by utilizing textured polygons. Despite the high-quality novel view rendering that NeRF provides, a critical limitation is that it relies on volume rendering that can be computationally expensive and does not utilize the advancements in modern graphics hardware. Many existing methods fall short when it comes to modelling volumetric effects as they rely purely on surface rendering. We thus propose to model the scene with polygons, which can then be used to obtain the quadrature points required to model volumetric effects, and also their opacity and colour from the texture. To obtain such polygonal mesh, we train a specialized field whose zero-crossings would correspond to the quadrature points when volume rendering, and perform marching cubes on this field. We then perform ray-tracing and utilize the ray-tracing shader to obtain the final colour image. Our method allows an easy integration with existing graphics frameworks allowing rendering speed of over 100 frames-per-second for a $1920\times1080$ image, while still being able to represent non-opaque objects.

📄 PDF Abstract BibTeX arXiv:2312.02202

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering

2021-11-19 · CVPR 2022 1 · Liwen Wu, Jae Yong Lee, Anand Bhattad, YuXiong Wang 외

DIVeR builds on the key ideas of NeRF and its variants -- density models and volume rendering -- to learn 3D object models that can be rendered realistically from small numbers of images. In contrast to all previous NeRF…

NeRF

GL-NeRF: Gauss-Laguerre Quadrature Enables Training-Free NeRF Acceleration

2024-10-19 · Silong Yong, Yaqi Xie, Simon Stepputtis, Katia Sycara

Volume rendering in neural radiance fields is inherently time-consuming due to the large number of MLP calls on the points sampled per ray. Previous works would address this issue by introducing new neural networks or da…

AttributeNeRF

LTM: Lightweight Textured Mesh Extraction and Refinement of Large Unbounded Scenes for Efficient Storage and Real-time Rendering

2024-01-01 · CVPR 2024 1 · Jaehoon Choi, Rajvi Shah, Qinbo Li, Yipeng Wang 외

Advancements in neural signed distance fields (SDFs) have enabled modeling 3D surface geometry from a set of 2D images of real-world scenes. Baking neural SDFs can extract explicit mesh with appearance baked into tex…

GPUNeRF

IBL-NeRF: Image-Based Lighting Formulation of Neural Radiance Fields

2022-10-15 · Changwoon Choi, Juhyeon Kim, Young Min Kim

We propose IBL-NeRF, which decomposes the neural radiance fields (NeRF) of large-scale indoor scenes into intrinsic components. Recent approaches further decompose the baked radiance of the implicit volume into intrinsic…

Inverse RenderingNeRF

Artist-Friendly Relightable and Animatable Neural Heads

2023-12-06 · CVPR 2024 1 · Yingyan Xu, Prashanth Chandran, Sebastian Weiss, Markus Gross 외

An increasingly common approach for creating photo-realistic digital avatars is through the use of volumetric neural fields. The original neural radiance field (NeRF) allowed for impressive novel view synthesis of static…

NeRFNovel View Synthesis