paper-with-me

Papers

Normal-GS: 3D Gaussian Splatting with Normal-Involved Rendering

2024-10-27 · Meng Wei, Qianyi Wu, Jianmin Zheng, Hamid Rezatofighi, Jianfei Cai

Rendering and reconstruction are long-standing topics in computer vision and graphics. Achieving both high rendering quality and accurate geometry is a challenge. Recent advancements in 3D Gaussian Splatting (3DGS) have enabled high-fidelity novel view synthesis at real-time speeds. However, the noisy and discrete nature of 3D Gaussian primitives hinders accurate surface estimation. Previous attempts to regularize 3D Gaussian normals often degrade rendering quality due to the fundamental disconnect between normal vectors and the rendering pipeline in 3DGS-based methods. Therefore, we introduce Normal-GS, a novel approach that integrates normal vectors into the 3DGS rendering pipeline. The core idea is to model the interaction between normals and incident lighting using the physically-based rendering equation. Our approach re-parameterizes surface colors as the product of normals and a designed Integrated Directional Illumination Vector (IDIV). To optimize memory usage and simplify optimization, we employ an anchor-based 3DGS to implicitly encode locally-shared IDIVs. Additionally, Normal-GS leverages optimized normals and Integrated Directional Encoding (IDE) to accurately model specular effects, enhancing both rendering quality and surface normal precision. Extensive experiments demonstrate that Normal-GS achieves near state-of-the-art visual quality while obtaining accurate surface normals and preserving real-time rendering performance.

📄 PDF Abstract BibTeX arXiv:2410.20593

Code (0)

등록된 구현이 없습니다.

Tasks

3DGSNovel View Synthesis

Similar Papers 제목 키워드 기반

GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces

2023-11-29 · CVPR 2024 1 · Yingwenqi Jiang, Jiadong Tu, YuAn Liu, Xifeng Gao 외

The advent of neural 3D Gaussians has recently brought about a revolution in the field of neural rendering, facilitating the generation of high-quality renderings at real-time speeds. However, the explicit and discrete r…

NeRFNeural Rendering

Uncertainty-Aware Normal-Guided Gaussian Splatting for Surface Reconstruction from Sparse Image Sequences

2025-03-14 · Zhen Tan, Xieyuanli Chen, Jinpu Zhang, Lei Feng 외

3D Gaussian Splatting (3DGS) has achieved impressive rendering performance in novel view synthesis. However, its efficacy diminishes considerably in sparse image sequences, where inherent data sparsity amplifies geometri…

3DGSNovel View SynthesisSurface Reconstruction

GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering

2024-10-31 · Kai Ye, Chong Gao, Guanbin Li, Wenzheng Chen 외

We consider the problem of physically-based inverse rendering using 3D Gaussian Splatting (3DGS) representations. While recent 3DGS methods have achieved remarkable results in novel view synthesis (NVS), accurately captu…

3DGSDisentanglementInverse RenderingNovel View Synthesis

GlossGau: Efficient Inverse Rendering for Glossy Surface with Anisotropic Spherical Gaussian

2025-02-19 · Bang Du, Runfa Blark Li, Chen Du, Truong Nguyen

The reconstruction of 3D objects from calibrated photographs represents a fundamental yet intricate challenge in the domains of computer graphics and vision. Although neural reconstruction approaches based on Neural Radi…

Inverse RenderingNeRF

3D Gaussian Splatting with Normal Information for Mesh Extraction and Improved Rendering

2025-01-14 · Meenakshi Krishnan, Liam Fowl, Ramani Duraiswami

Differentiable 3D Gaussian splatting has emerged as an efficient and flexible rendering technique for representing complex scenes from a collection of 2D views and enabling high-quality real-time novel-view synthesis. Ho…

Novel View SynthesisVideo Generation