paper-with-me

Papers

PRTGaussian: Efficient Relighting Using 3D Gaussians with Precomputed Radiance Transfer

2024-08-10 · Libo Zhang, Yuxuan Han, Wenbin Lin, Jingwang Ling, Feng Xu

We present PRTGaussian, a realtime relightable novel-view synthesis method made possible by combining 3D Gaussians and Precomputed Radiance Transfer (PRT). By fitting relightable Gaussians to multi-view OLAT data, our method enables real-time, free-viewpoint relighting. By estimating the radiance transfer based on high-order spherical harmonics, we achieve a balance between capturing detailed relighting effects and maintaining computational efficiency. We utilize a two-stage process: in the first stage, we reconstruct a coarse geometry of the object from multi-view images. In the second stage, we initialize 3D Gaussians with the obtained point cloud, then simultaneously refine the coarse geometry and learn the light transport for each Gaussian. Extensive experiments on synthetic datasets show that our approach can achieve fast and high-quality relighting for general objects. Code and data are available at https://github.com/zhanglbthu/PRTGaussian.

📄 PDF Abstract BibTeX arXiv:2408.05631

Code (1)

zhanglbthu/prtgaussian 공식 구현

Tasks

Computational EfficiencyNovel View Synthesis

Similar Papers 제목 키워드 기반

PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relighting

2024-08-07 · Yijia Guo, Yuanxi Bai, Liwen Hu, Ziyi Guo 외

We proposed Precomputed RadianceTransfer of GaussianSplats (PRTGS), a real-time high-quality relighting method for Gaussian splats in low-frequency lighting environments that captures soft shadows and interreflections by…

3DGS

Single-image Full-body Human Relighting

2021-07-15 · Manuel Lagunas, Xin Sun, Jimei Yang, Ruben Villegas 외

We present a single-image data-driven method to automatically relight images with full-body humans in them. Our framework is based on a realistic scene decomposition leveraging precomputed radiance transfer (PRT) and sph…

Image Reconstruction

Neural Free-Viewpoint Relighting for Glossy Indirect Illumination

2023-07-12 · Nithin Raghavan, Yan Xiao, Kai-En Lin, Tiancheng Sun 외

Precomputed Radiance Transfer (PRT) remains an attractive solution for real-time rendering of complex light transport effects such as glossy global illumination. After precomputation, we can relight the scene with new en…

Tensor Decomposition

Relightable Gaussian Codec Avatars

2023-12-06 · CVPR 2024 1 · Shunsuke Saito, Gabriel Schwartz, Tomas Simon, Junxuan Li 외

The fidelity of relighting is bounded by both geometry and appearance representations. For geometry, both mesh and volumetric approaches have difficulty modeling intricate structures like 3D hair geometry. For appearance…

Relightable Full-Body Gaussian Codec Avatars

2025-01-24 · Shaofei Wang, Tomas Simon, Igor Santesteban, Timur Bagautdinov 외

We propose Relightable Full-Body Gaussian Codec Avatars, a new approach for modeling relightable full-body avatars with fine-grained details including face and hands. The unique challenge for relighting full-body avatars…