paper-with-me

홈 › Papers

UniSplat: Unified Spatio-Temporal Fusion via 3D Latent Scaffolds for Dynamic Driving Scene Reconstruction

2025-11-06 · Chen Shi, Shaoshuai Shi, Xiaoyang Lyu, Chunyang Liu, Kehua Sheng, Bo Zhang, Li Jiang arxiv

Feed-forward 3D reconstruction for autonomous driving has advanced rapidly, yet existing methods struggle with the joint challenges of sparse, non-overlapping camera views and complex scene dynamics. We present UniSplat, a general feed-forward framework that learns robust dynamic scene reconstruction through unified latent spatio-temporal fusion. UniSplat constructs a 3D latent scaffold, a structured representation that captures geometric and semantic scene context by leveraging pretrained foundation models. To effectively integrate information across spatial views and temporal frames, we introduce an efficient fusion mechanism that operates directly within the 3D scaffold, enabling consistent spatio-temporal alignment. To ensure complete and detailed reconstructions, we design a dual-branch decoder that generates dynamic-aware Gaussians from the fused scaffold by combining point-anchored refinement with voxel-based generation, and maintain a persistent memory of static Gaussians to enable streaming scene completion beyond current camera coverage. Extensive experiments on real-world datasets demonstrate that UniSplat achieves state-of-the-art performance in novel view synthesis, while providing robust and high-quality renderings even for viewpoints outside the original camera coverage.

📄 PDF Abstract BibTeX arXiv:2511.04595

Code (0)

등록된 구현이 없습니다.

Tasks

Novel View SynthesisAutonomous Driving3D Reconstruction

Similar Papers 제목 키워드 기반

ProAV-DiT: A Projected Latent Diffusion Transformer for Efficient Synchronized Audio-Video Generation

2025-11-15 · Jiahui Sun, Weining Wang, Mingzhen Sun, Yirong Yang 외 arxiv

Sounding Video Generation (SVG) remains a challenging task due to the inherent structural misalignment between audio and video, as well as the high computational cost of multimodal data processing. In this paper, we intr…

Computational EfficiencyVideo Generation

CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis

2026-03-26 · Marvin Seyfarth, Sarah Kaye Müller, Arman Ghanaat, Isabelle Ayx 외 arxiv

Latent diffusion models (LDMs) have recently achieved strong performance in 3D medical image synthesis. However, modalities like cine cardiac MRI (CMR), representing a temporally synchronized 3D volume across the cardiac…

Generative Neural Video Compression via Video Diffusion Prior

2025-12-04 · Qi Mao, Hao Cheng, Tinghan Yang, Libiao Jin 외 arxiv

We present GNVC-VD, the first DiT-based generative neural video compression framework built upon an advanced video generation foundation model, where spatio-temporal latent compression and sequence-level generative refin…

Video Generation

VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioning

2025-10-09 · Minghong Cai, Qiulin Wang, Zongli Ye, Wenze Liu 외 arxiv

Existing controllable video generation methods are typically designed for rigid, task-specific settings, such as first-frame image-to-video, inpainting, or interpolation, treating spatio-temporal control as a set of isol…

Video Generation

4D-VGGT: A General Foundation Model with SpatioTemporal Awareness for Dynamic Scene Geometry Estimation

2025-11-23 · Haonan Wang, Hanyu Zhou, Haoyue Liu, Luxin Yan arxiv

We investigate a challenging task of dynamic scene geometry estimation, which requires representing both spatial and temporal features. Typically, existing methods align the two features into a unified latent space to mo…