paper-with-me

Papers

PEP-GS: Perceptually-Enhanced Precise Structured 3D Gaussians for View-Adaptive Rendering

2024-11-08 · Junxi Jin, Xiulai Li, Haiping Huang, Lianjun Liu, Yujie Sun, Logan Liu

Recently, 3D Gaussian Splatting (3D-GS) has achieved significant success in real-time, high-quality 3D scene rendering. However, it faces several challenges, including Gaussian redundancy, limited ability to capture view-dependent effects, and difficulties in handling complex lighting and specular reflections. Additionally, methods that use spherical harmonics for color representation often struggle to effectively capture anisotropic components, especially when modeling view-dependent colors under complex lighting conditions, leading to insufficient contrast and unnatural color saturation. To address these limitations, we introduce PEP-GS, a perceptually-enhanced framework that dynamically predicts Gaussian attributes, including opacity, color, and covariance. We replace traditional spherical harmonics with a Hierarchical Granular-Structural Attention mechanism, which enables more accurate modeling of complex view-dependent color effects. By employing a stable and interpretable framework for opacity and covariance estimation, PEP-GS avoids the removal of essential Gaussians prematurely, ensuring a more accurate scene representation. Furthermore, perceptual optimization is applied to the final rendered images, enhancing perceptual consistency across different views and ensuring high-quality renderings with improved texture fidelity and fine-scale detail preservation. Experimental results demonstrate that PEP-GS outperforms state-of-the-art methods, particularly in challenging scenarios involving view-dependent effects and fine-scale details.

📄 PDF Abstract BibTeX arXiv:2411.05731

Code (0)

등록된 구현이 없습니다.

Tasks

Kolmogorov-Arnold Networks

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Laplacian Pyramid 설명 없음

Similar Papers 제목 키워드 기반

Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering

2023-11-30 · CVPR 2024 1 · Tao Lu, Mulin Yu, Linning Xu, Yuanbo Xiangli 외

Neural rendering methods have significantly advanced photo-realistic 3D scene rendering in various academic and industrial applications. The recent 3D Gaussian Splatting method has achieved the state-of-the-art rendering…

Neural Rendering

From Far and Near: Perceptual Evaluation of Crowd Representations Across Levels of Detail

2025-10-23 · Xiaohan Sun, Carol O'Sullivan arxiv

In this paper, we investigate how users perceive the visual quality of crowd character representations at different levels of detail (LoD) and viewing distances. Each representation, including geometric meshes, image-bas…

Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars

2025-07-21 · Marcel C. Bühler, Ye Yuan, Xueting Li, Yangyi Huang 외 arxiv

We introduce Dream, Lift, Animate (DLA), a novel framework that reconstructs animatable 3D human avatars from a single image. This is achieved by leveraging multi-view generation, 3D Gaussian lifting, and pose-aware UV-s…

GeoGaussian: Geometry-aware Gaussian Splatting for Scene Rendering

2024-03-17 · Yanyan Li, Chenyu Lyu, Yan Di, Guangyao Zhai 외

During the Gaussian Splatting optimization process, the scene's geometry can gradually deteriorate if its structure is not deliberately preserved, especially in non-textured regions such as walls, ceilings, and furniture…

Novel View Synthesis

GaussianSpeech: Audio-Driven Gaussian Avatars

2024-11-27 · Shivangi Aneja, Artem Sevastopolsky, Tobias Kirschstein, Justus Thies 외

We introduce GaussianSpeech, a novel approach that synthesizes high-fidelity animation sequences of photo-realistic, personalized 3D human head avatars from spoken audio. To capture the expressive, detailed nature of hum…

3DGS