paper-with-me

홈 › Papers

4D Scaffold Gaussian Splatting for Memory Efficient Dynamic Scene Reconstruction

2024-11-26 · Woong Oh Cho, In Cho, Seoha Kim, Jeongmin Bae, Youngjung Uh, Seon Joo Kim

Existing 4D Gaussian methods for dynamic scene reconstruction offer high visual fidelity and fast rendering. However, these methods suffer from excessive memory and storage demands, which limits their practical deployment. This paper proposes a 4D anchor-based framework that retains visual quality and rendering speed of 4D Gaussians while significantly reducing storage costs. Our method extends 3D scaffolding to 4D space, and leverages sparse 4D grid-aligned anchors with compressed feature vectors. Each anchor models a set of neural 4D Gaussians, each of which represent a local spatiotemporal region. In addition, we introduce a temporal coverage-aware anchor growing strategy to effectively assign additional anchors to under-reconstructed dynamic regions. Our method adjusts the accumulated gradients based on Gaussians' temporal coverage, improving reconstruction quality in dynamic regions. To reduce the number of anchors, we further present enhanced formulations of neural 4D Gaussians. These include the neural velocity, and the temporal opacity derived from a generalized Gaussian distribution. Experimental results demonstrate that our method achieves state-of-the-art visual quality and 97.8% storage reduction over 4DGS.

📄 PDF Abstract BibTeX arXiv:2411.17044

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

MoDec-GS: Global-to-Local Motion Decomposition and Temporal Interval Adjustment for Compact Dynamic 3D Gaussian Splatting

2025-01-07 · CVPR 2025 1 · Sangwoon Kwak, Joonsoo Kim, Jun Young Jeong, Won-Sik Cheong 외

3D Gaussian Splatting (3DGS) has made significant strides in scene representation and neural rendering, with intense efforts focused on adapting it for dynamic scenes. Despite delivering remarkable rendering quality and …

3DGSNeural RenderingVideo Reconstruction

MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds

2024-05-27 · CVPR 2025 1 · Jiahui Lei, Yijia Weng, Adam Harley, Leonidas Guibas 외

We introduce 4D Motion Scaffolds (MoSca), a modern 4D reconstruction system designed to reconstruct and synthesize novel views of dynamic scenes from monocular videos captured casually in the wild. To address such a chal…

4D reconstructionPose Estimation

4D Neural Voxel Splatting: Dynamic Scene Rendering with Voxelized Guassian Splatting

2025-11-01 · Chun-Tin Wu, Jun-Cheng Chen arxiv

Although 3D Gaussian Splatting (3D-GS) achieves efficient rendering for novel view synthesis, extending it to dynamic scenes still results in substantial memory overhead from replicating Gaussians across frames. To addre…

Novel View Synthesis

Prior-Enhanced Gaussian Splatting for Dynamic Scene Reconstruction from Casual Video

2025-12-12 · Meng-Li Shih, Ying-Huan Chen, Yu-Lun Liu, Brian Curless arxiv

We introduce a fully automatic pipeline for dynamic scene reconstruction from casually captured monocular RGB videos. Rather than designing a new scene representation, we enhance the priors that drive Dynamic Gaussian Sp…

Video Segmentation

AH-GS: Augmented 3D Gaussian Splatting for High-Frequency Detail Representation

2025-03-28 · Chenyang Xu, XingGuo Deng, Rui Zhong

The 3D Gaussian Splatting (3D-GS) is a novel method for scene representation and view synthesis. Although Scaffold-GS achieves higher quality real-time rendering compared to the original 3D-GS, its fine-grained rendering…

Image Reconstruction