paper-with-me

Papers

GS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis

2024-05-31 · Yumeng He, Yunbo Wang, Xiaokang Yang

Decoupling the illumination in 3D scenes is crucial for novel view synthesis and relighting. In this paper, we propose a novel method for representing a scene illuminated by a point light using a set of relightable 3D Gaussian points. Inspired by the Blinn-Phong model, our approach decomposes the scene into ambient, diffuse, and specular components, enabling the synthesis of realistic lighting effects. To facilitate the decomposition of geometric information independent of lighting conditions, we introduce a novel bilevel optimization-based meta-learning framework. The fundamental idea is to view the rendering tasks under various lighting positions as a multi-task learning problem, which our meta-learning approach effectively addresses by generalizing the learned Gaussian geometries not only across different viewpoints but also across diverse light positions. Experimental results demonstrate the effectiveness of our approach in terms of training efficiency and rendering quality compared to existing methods for free-viewpoint relighting.

📄 PDF Abstract BibTeX arXiv:2405.20791

Code (1)

ymhe12/GS-Phong 공식 구현 pytorch

Tasks

Bilevel OptimizationMeta-LearningMulti-Task LearningNovel View Synthesis

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

FaceLit: Neural 3D Relightable Faces

2023-03-27 · CVPR 2023 1 · Anurag Ranjan, Kwang Moo Yi, Jen-Hao Rick Chang, Oncel Tuzel

We propose a generative framework, FaceLit, capable of generating a 3D face that can be rendered at various user-defined lighting conditions and views, learned purely from 2D images in-the-wild without any manual annotat…

PRTGaussian: Efficient Relighting Using 3D Gaussians with Precomputed Radiance Transfer

2024-08-10 · Libo Zhang, Yuxuan Han, Wenbin Lin, Jingwang Ling 외

We present PRTGaussian, a realtime relightable novel-view synthesis method made possible by combining 3D Gaussians and Precomputed Radiance Transfer (PRT). By fitting relightable Gaussians to multi-view OLAT data, our me…

Computational EfficiencyNovel View Synthesis

F-RNG: Feed-Forward Relightable Neural Gaussians

2026-05-25 · Guangming Fu, Jiahui Fan, Jian Yang, Miloš Hašan 외 arxiv

Capturing relightable 3D assets from real-world objects is a widely researched problem. Several per-scene optimization-based methods, based on 3D Gaussian splatting (3DGS), support relighting; however, they usually requi…

COREA: Coupled Relightable 3D Gaussians and SDFs for Efficient Normal Alignment

2025-12-08 · Jaeyoon Lee, Hojoon Jung, Sungtae Hwang, Jihyong Oh 외 arxiv

We present COREA, the first unified three-tasks framework that couples an SDF and relightable 3D Gaussians (3DGS) to jointly support SH-based novel-view synthesis (NVS), surface reconstruction, and inverse physically-bas…

RNG: Relightable Neural Gaussians

2024-09-29 · CVPR 2025 1 · Jiahui Fan, Fujun Luan, Jian Yang, Miloš Hašan 외

3D Gaussian Splatting (3DGS) has shown impressive results for the novel view synthesis task, where lighting is assumed to be fixed. However, creating relightable 3D assets, especially for objects with ill-defined shapes …

3DGSNovel View Synthesis