ChronosObserver: Taming 4D World with Hyperspace Diffusion Sampling
Although prevailing camera-controlled video generation models can produce cinematic results, lifting them directly to the generation of 3D-consistent and high-fidelity time-synchronized multi-view videos remains challenging, which is a pivotal capability for taming 4D worlds. Some works resort to data augmentation or test-time optimization, but these strategies are constrained by limited model generalization and scalability issues. To this end, we propose ChronosObserver, a training-free method including World State Hyperspace to represent the spatiotemporal constraints of a 4D world scene, and Hyperspace Guided Sampling to synchronize the diffusion sampling trajectories of multiple views using the hyperspace. Experimental results demonstrate that our method achieves high-fidelity and 3D-consistent time-synchronized multi-view videos generation without training or fine-tuning for diffusion models.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationVideo GenerationSimilar Papers 제목 키워드 기반
Boundary Aware Learning for Out-of-distribution Detection
This paper focuses on the problem of detecting out-of-distribution (ood) samples with neural nets. In image recognition tasks, the trained classifier often gives high confidence score for input images which are remote fr…
Out-of-Distribution DetectionOut of Distribution (OOD) DetectionTaming Diffusion Prior for Image Super-Resolution with Domain Shift SDEs
Diffusion-based image super-resolution (SR) models have attracted substantial interest due to their powerful image restoration capabilities. However, prevailing diffusion models often struggle to strike an optimal balanc…
Image RestorationImage Super-ResolutionSuper-ResolutionTaming Sampling Perturbations with Variance Expansion Loss for Latent Diffusion Models
Latent diffusion models have emerged as the dominant framework for high-fidelity and efficient image generation, owing to their ability to learn diffusion processes in compact latent spaces. However, while previous resea…
Image GenerationHyperSpace: Hypernetworks for spacing-adaptive image segmentation
Medical images are often acquired in different settings, requiring harmonization to adapt to the operating point of algorithms. Specifically, to standardize the physical spacing of imaging voxels in heterogeneous inferen…
Image SegmentationSemantic SegmentationHyperSpace: A Generalized Framework for Spatial Encoding in Hyperdimensional Representations
Vector Symbolic Architectures (VSAs) provide a well-defined algebraic framework for compositional representations in hyperdimensional spaces. We introduce HyperSpace, an open-source framework that decomposes VSA systems …