paper-with-me

홈 › Papers

Modeling Ambient Scene Dynamics for Free-view Synthesis

2024-06-13 · Meng-Li Shih, Jia-Bin Huang, Changil Kim, Rajvi Shah, Johannes Kopf, Chen Gao

We introduce a novel method for dynamic free-view synthesis of an ambient scenes from a monocular capture bringing a immersive quality to the viewing experience. Our method builds upon the recent advancements in 3D Gaussian Splatting (3DGS) that can faithfully reconstruct complex static scenes. Previous attempts to extend 3DGS to represent dynamics have been confined to bounded scenes or require multi-camera captures, and often fail to generalize to unseen motions, limiting their practical application. Our approach overcomes these constraints by leveraging the periodicity of ambient motions to learn the motion trajectory model, coupled with careful regularization. We also propose important practical strategies to improve the visual quality of the baseline 3DGS static reconstructions and to improve memory efficiency critical for GPU-memory intensive learning. We demonstrate high-quality photorealistic novel view synthesis of several ambient natural scenes with intricate textures and fine structural elements.

📄 PDF Abstract BibTeX arXiv:2406.09395

Code (0)

등록된 구현이 없습니다.

Tasks

3DGSGPUNovel View Synthesis

Similar Papers 제목 키워드 기반

VividDream: Generating 3D Scene with Ambient Dynamics

2024-05-30 · Yao-Chih Lee, Yi-Ting Chen, Andrew Wang, Ting-Hsuan Liao 외

We introduce VividDream, a method for generating explorable 4D scenes with ambient dynamics from a single input image or text prompt. VividDream first expands an input image into a static 3D point cloud through iterative…

SUNDIAL: 3D Satellite Understanding through Direct, Ambient, and Complex Lighting Decomposition

2023-12-24 · Nikhil Behari, Akshat Dave, Kushagra Tiwary, William Yang 외

3D modeling from satellite imagery is essential in areas of environmental science, urban planning, agriculture, and disaster response. However, traditional 3D modeling techniques face unique challenges in the remote sens…

3D ReconstructionDisaster ResponseDisentanglementNeRF+1

GS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis

2024-05-31 · Yumeng He, Yunbo Wang, Xiaokang Yang

Decoupling the illumination in 3D scenes is crucial for novel view synthesis and relighting. In this paper, we propose a novel method for representing a scene illuminated by a point light using a set of relightable 3D Ga…

Bilevel OptimizationMeta-LearningMulti-Task LearningNovel View Synthesis

Opportunistic Single-Photon Time of Flight

2025-01-01 · CVPR 2025 1 · Sotiris Nousias, Mian Wei, Howard Xiao, Maxx Wu 외

Scattered light from pulsed lasers is increasingly part of our ambient illumination, as many devices rely on them for active 3D sensing. In this work, we ask: can these "ambient" light signals be detected and leverag…

SonoWorld: From One Image to a 3D Audio-Visual Scene

2026-03-30 · Derong Jin, Xiyi Chen, Ming C. Lin, Ruohan Gao arxiv

Tremendous progress in visual scene generation now turns a single image into an explorable 3D world, yet immersion remains incomplete without sound. We introduce Image2AVScene, the task of generating a 3D audio-visual sc…

Scene Generation