paper-with-me

Papers

Gaussian in the Dark: Real-Time View Synthesis From Inconsistent Dark Images Using Gaussian Splatting

2024-08-17 · Sheng Ye, Zhen-Hui Dong, Yubin Hu, Yu-Hui Wen, Yong-Jin Liu

3D Gaussian Splatting has recently emerged as a powerful representation that can synthesize remarkable novel views using consistent multi-view images as input. However, we notice that images captured in dark environments where the scenes are not fully illuminated can exhibit considerable brightness variations and multi-view inconsistency, which poses great challenges to 3D Gaussian Splatting and severely degrades its performance. To tackle this problem, we propose Gaussian-DK. Observing that inconsistencies are mainly caused by camera imaging, we represent a consistent radiance field of the physical world using a set of anisotropic 3D Gaussians, and design a camera response module to compensate for multi-view inconsistencies. We also introduce a step-based gradient scaling strategy to constrain Gaussians near the camera, which turn out to be floaters, from splitting and cloning. Experiments on our proposed benchmark dataset demonstrate that Gaussian-DK produces high-quality renderings without ghosting and floater artifacts and significantly outperforms existing methods. Furthermore, we can also synthesize light-up images by controlling exposure levels that clearly show details in shadow areas.

📄 PDF Abstract BibTeX arXiv:2408.09130

Code (2)

yec22/Gaussian-DK 공식 구현
cuiziteng/Luminance-GS jax

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesis

2024-06-10 · Xin Jin, Pengyi Jiao, Zheng-Peng Duan, Xingchao Yang 외

Volumetric rendering based methods, like NeRF, excel in HDR view synthesis from RAWimages, especially for nighttime scenes. While, they suffer from long training times and cannot perform real-time rendering due to dense …

2k3DGSNeRFNovel View Synthesis+1

Dark3R: Learning Structure from Motion in the Dark

2026-03-05 · Andrew Y Guo, Anagh Malik, SaiKiran Tedla, Yutong Dai 외 arxiv

We introduce Dark3R, a framework for structure from motion in the dark that operates directly on raw images with signal-to-noise ratios (SNRs) below $-4$ dB -- a regime where conventional feature- and learning-based meth…

Camera Pose EstimationNovel View Synthesis

Dark-EvGS: Event Camera as an Eye for Radiance Field in the Dark

2025-07-16 · Jingqian Wu, Peiqi Duan, Zongqiang Wang, Changwei Wang 외

In low-light environments, conventional cameras often struggle to capture clear multi-view images of objects due to dynamic range limitations and motion blur caused by long exposure. Event cameras, with their high-dynami…

Triplet

Light 'em Up: Enabling Few-Shot Low-Light 3D Gaussian Splatting with Multi-Scale Explicit Retinex Illumination Decoupling

2026-04-27 · YuHao Yin, Zongji Wang, Yuanben Zhang, Biqing Li 외 arxiv

Full 360$^\circ$ novel view synthesis under low-light conditions remains challenging. Insufficient illumination, noise amplification, and view-dependent photometric inconsistencies prevent existing methods from jointly p…

Novel View Synthesis

DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark

2024-03-16 · Tianyi Zhang, Kaining Huang, Weiming Zhi, Matthew Johnson-Roberson

Humans have the remarkable ability to construct consistent mental models of an environment, even under limited or varying levels of illumination. We wish to endow robots with this same capability. In this paper, we tackl…