paper-with-me

Papers

Spatiotemporal Skip Guidance for Enhanced Video Diffusion Sampling

2024-11-27 · CVPR 2025 1 · Junha Hyung, Kinam Kim, Susung Hong, Min-Jung Kim, Jaegul Choo

Diffusion models have emerged as a powerful tool for generating high-quality images, videos, and 3D content. While sampling guidance techniques like CFG improve quality, they reduce diversity and motion. Autoguidance mitigates these issues but demands extra weak model training, limiting its practicality for large-scale models. In this work, we introduce Spatiotemporal Skip Guidance (STG), a simple training-free sampling guidance method for enhancing transformer-based video diffusion models. STG employs an implicit weak model via self-perturbation, avoiding the need for external models or additional training. By selectively skipping spatiotemporal layers, STG produces an aligned, degraded version of the original model to boost sample quality without compromising diversity or dynamic degree. Our contributions include: (1) introducing STG as an efficient, high-performing guidance technique for video diffusion models, (2) eliminating the need for auxiliary models by simulating a weak model through layer skipping, and (3) ensuring quality-enhanced guidance without compromising sample diversity or dynamics unlike CFG. For additional results, visit https://junhahyung.github.io/STGuidance.

📄 PDF Abstract BibTeX arXiv:2411.18664

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

GlobalPaint: Spatiotemporal Coherent Video Outpainting with Global Feature Guidance

2026-01-10 · Yueming Pan, Ruoyu Feng, Jianmin Bao, Chong Luo 외 arxiv

Video outpainting extends a video beyond its original boundaries by synthesizing missing border content. Compared with image outpainting, it requires not only per-frame spatial plausibility but also long-range temporal c…

Image OutpaintingImage Inpainting

RSTR: Reducing SpatioTemporal Redundancy in Diffusion Transformers

2025-12-16 · Ruitong Sun, Tianze Yang, Wei Niu, Jin Sun arxiv

Diffusion Transformers (DiTs) have achieved remarkable success in image generation, yet their deployment is hindered by high computational costs. We identify two sources of redundancy. First, temporal redundancy: Classif…

Image Generation

DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution

2026-05-13 · Zheng Chen, Ruofan Yang, Jin Han, Dehua Song 외 arxiv

Diffusion-based models have shown strong performance in video super-resolution (VSR) and video frame interpolation (VFI). However, their role in the coupled space-time video super-resolution (STVSR) setting remains limit…

Space-time Video Super-resolutionVideo Frame Interpolation

ExtDM: Distribution Extrapolation Diffusion Model for Video Prediction

2024-01-01 · CVPR 2024 1 · Zhicheng Zhang, Junyao Hu, Wentao Cheng, Danda Paudel 외

Video prediction is a challenging task due to its nature of uncertainty especially for forecasting a long period. To model the temporal dynamics advanced methods benefit from the recent success of diffusion models an…

PredictionVideo Prediction

LLM-grounded Video Diffusion Models

2023-09-29 · Long Lian, Baifeng Shi, Adam Yala, Trevor Darrell 외

Text-conditioned diffusion models have emerged as a promising tool for neural video generation. However, current models still struggle with intricate spatiotemporal prompts and often generate restricted or incorrect moti…

Language ModelingLanguage ModellingLarge Language ModelVideo Generation