paper-with-me

홈 › Papers

DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenes

2024-12-15 · CVPR 2025 1 · Jinxiu Liu, Shaoheng Lin, Yinxiao Li, Ming-Hsuan Yang

The increasing demand for immersive AR/VR applications and spatial intelligence has heightened the need to generate high-quality scene-level and 360{\deg} panoramic video. However, most video diffusion models are constrained by limited resolution and aspect ratio, which restricts their applicability to scene-level dynamic content synthesis. In this work, we propose the DynamicScaler, addressing these challenges by enabling spatially scalable and panoramic dynamic scene synthesis that preserves coherence across panoramic scenes of arbitrary size. Specifically, we introduce a Offset Shifting Denoiser, facilitating efficient, synchronous, and coherent denoising panoramic dynamic scenes via a diffusion model with fixed resolution through a seamless rotating Window, which ensures seamless boundary transitions and consistency across the entire panoramic space, accommodating varying resolutions and aspect ratios. Additionally, we employ a Global Motion Guidance mechanism to ensure both local detail fidelity and global motion continuity. Extensive experiments demonstrate our method achieves superior content and motion quality in panoramic scene-level video generation, offering a training-free, efficient, and scalable solution for immersive dynamic scene creation with constant VRAM consumption regardless of the output video resolution. Our project page is available at \url{https://dynamic-scaler.pages.dev/}.

📄 PDF Abstract BibTeX arXiv:2412.11100

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingVideo Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

PanoWan: Lifting Diffusion Video Generation Models to 360° with Latitude/Longitude-aware Mechanisms

2025-05-28 · Yifei Xia, Shuchen Weng, Siqi Yang, Jingqi Liu 외

Panoramic video generation enables immersive 360{\deg} content creation, valuable in applications that demand scene-consistent world exploration. However, existing panoramic video generation models struggle to leverage p…

DenoisingVideo Generation

DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusion

2024-10-31 · Weicai Ye, Chenhao Ji, Zheng Chen, Junyao Gao 외

Diffusion-based methods have achieved remarkable achievements in 2D image or 3D object generation, however, the generation of 3D scenes and even $360^{\circ}$ images remains constrained, due to the limited number of scen…

Scene Generation

HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene Generation

2025-04-30 · Haiyang Zhou, Wangbo Yu, Jiawen Guan, Xinhua Cheng 외

The rapid advancement of diffusion models holds the promise of revolutionizing the application of VR and AR technologies, which typically require scene-level 4D assets for user experience. Nonetheless, existing diffusion…

Depth EstimationScene GenerationVideo Generation

SphereDiff: Tuning-free Omnidirectional Panoramic Image and Video Generation via Spherical Latent Representation

2025-04-19 · Minho Park, Taewoong Kang, Jooyeol Yun, Sungwon Hwang 외

The increasing demand for AR/VR applications has highlighted the need for high-quality 360-degree panoramic content. However, generating high-quality 360-degree panoramic images and videos remains a challenging task due …

ERPVideo Generation

CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusion

2025-09-24 · Chenhao Ji, Chaohui Yu, Junyao Gao, Fan Wang 외 arxiv

Recently, camera-controlled video generation has seen rapid development, offering more precise control over video generation. However, existing methods predominantly focus on camera control in perspective projection vide…

Video Generation