paper-with-me

Papers

DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization

2024-03-11 · CVPR 2024 1 · Jiahe Li, Jiawei Zhang, Xiao Bai, Jin Zheng, Xin Ning, Jun Zhou, Lin Gu

Radiance fields have demonstrated impressive performance in synthesizing novel views from sparse input views, yet prevailing methods suffer from high training costs and slow inference speed. This paper introduces DNGaussian, a depth-regularized framework based on 3D Gaussian radiance fields, offering real-time and high-quality few-shot novel view synthesis at low costs. Our motivation stems from the highly efficient representation and surprising quality of the recent 3D Gaussian Splatting, despite it will encounter a geometry degradation when input views decrease. In the Gaussian radiance fields, we find this degradation in scene geometry primarily lined to the positioning of Gaussian primitives and can be mitigated by depth constraint. Consequently, we propose a Hard and Soft Depth Regularization to restore accurate scene geometry under coarse monocular depth supervision while maintaining a fine-grained color appearance. To further refine detailed geometry reshaping, we introduce Global-Local Depth Normalization, enhancing the focus on small local depth changes. Extensive experiments on LLFF, DTU, and Blender datasets demonstrate that DNGaussian outperforms state-of-the-art methods, achieving comparable or better results with significantly reduced memory cost, a $25 \times$ reduction in training time, and over $3000 \times$ faster rendering speed.

📄 PDF Abstract BibTeX arXiv:2403.06912

Code (1)

fictionarry/dngaussian 공식 구현 pytorch

Tasks

Novel View Synthesis

Methods 이 논문이 사용한 방법론

Focus 설명 없음
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstruction

2024-09-05 · Shen Chen, Jiale Zhou, Lei LI

3D Gaussian Splatting (3DGS) has emerged as a promising approach for 3D scene representation, offering a reduction in computational overhead compared to Neural Radiance Fields (NeRF). However, 3DGS is susceptible to high…

3DGS3D ReconstructionNeRFNovel View Synthesis+1

AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings

2026-06-30 · Lorenzo Lazzaroni, Riccardo Bollati, Daniel Barath, Michael Niemeyer 외 arxiv

Generating high-quality novel views at real-time frame rates remains a central challenge in 3D vision, particularly in sparse-view scenarios. Neural radiance fields have demonstrated robust reconstruction from limited ob…

CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularization

2024-05-20 · Jiawei Zhang, Jiahe Li, Xiaohan Yu, Lei Huang 외

3D Gaussian Splatting (3DGS) creates a radiance field consisting of 3D Gaussians to represent a scene. With sparse training views, 3DGS easily suffers from overfitting, negatively impacting rendering. This paper introduc…

3DGSNovel View Synthesis

3D Gaussian Splatting for Real-Time Radiance Field Rendering

2023-08-08 · Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis

Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train a…

Camera CalibrationNovel View Synthesis

SmileSplat: Generalizable Gaussian Splats for Unconstrained Sparse Images

2024-11-27 · Yanyan Li, Yixin Fang, Federico Tombari, Gim Hee Lee

Sparse Multi-view Images can be Learned to predict explicit radiance fields via Generalizable Gaussian Splatting approaches, which can achieve wider application prospects in real-life when ground-truth camera parameters …

DecoderNovel View Synthesis