paper-with-me

홈 › Papers

Neural Point Light Fields

2021-12-02 · CVPR 2022 1 · Julian Ost, Issam Laradji, Alejandro Newell, Yuval Bahat, Felix Heide

We introduce Neural Point Light Fields that represent scenes implicitly with a light field living on a sparse point cloud. Combining differentiable volume rendering with learned implicit density representations has made it possible to synthesize photo-realistic images for novel views of small scenes. As neural volumetric rendering methods require dense sampling of the underlying functional scene representation, at hundreds of samples along a ray cast through the volume, they are fundamentally limited to small scenes with the same objects projected to hundreds of training views. Promoting sparse point clouds to neural implicit light fields allows us to represent large scenes effectively with only a single radiance evaluation per ray. These point light fields are a function of the ray direction, and local point feature neighborhood, allowing us to interpolate the light field conditioned training images without dense object coverage and parallax. We assess the proposed method for novel view synthesis on large driving scenarios, where we synthesize realistic unseen views that existing implicit approaches fail to represent. We validate that Neural Point Light Fields make it possible to predict videos along unseen trajectories previously only feasible to generate by explicitly modeling the scene.

📄 PDF Abstract BibTeX arXiv:2112.01473

Code (0)

등록된 구현이 없습니다.

Tasks

Novel View Synthesis

Similar Papers 제목 키워드 기반

Learning Neural Transmittance for Efficient Rendering of Reflectance Fields

2021-10-25 · Mohammad Shafiei, Sai Bi, Zhengqin Li, Aidas Liaudanskas 외

Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions…

Relighting4D: Neural Relightable Human from Videos

2022-07-14 · Zhaoxi Chen, Ziwei Liu

Human relighting is a highly desirable yet challenging task. Existing works either require expensive one-light-at-a-time (OLAT) captured data using light stage or cannot freely change the viewpoints of the rendered body.…

Neural Reflectance Fields for Appearance Acquisition

2020-08-09 · Sai Bi, Zexiang Xu, Pratul Srinivasan, Ben Mildenhall 외

We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene using a fully-connected neural network. We combine this re…

NLDF: Neural Light Dynamic Fields for Efficient 3D Talking Head Generation

2024-06-17 · Niu Guanchen

Talking head generation based on the neural radiation fields model has shown promising visual effects. However, the slow rendering speed of NeRF seriously limits its application, due to the burdensome calculation process…

Knowledge DistillationNeRFTalking Head GenerationVideo Generation

ReNeRF: Relightable Neural Radiance Fields with Nearfield Lighting

2023-01-01 · ICCV 2023 1 · Yingyan Xu, Gaspard Zoss, Prashanth Chandran, Markus Gross 외

Recent work on radiance fields and volumetric inverse rendering (e.g., NeRFs) has provided excellent results in building data-driven models of real scenes for novel view synthesis with high photorealism. While full c…

Inverse RenderingNovel View Synthesis