paper-with-me

홈 › Papers

Less is More: Improving Motion Diffusion Models with Sparse Keyframes

2025-03-18 · Jinseok Bae, Inwoo Hwang, Young Yoon Lee, Ziyu Guo, Joseph Liu, Yizhak Ben-Shabat, Young Min Kim, Mubbasir Kapadia

Recent advances in motion diffusion models have led to remarkable progress in diverse motion generation tasks, including text-to-motion synthesis. However, existing approaches represent motions as dense frame sequences, requiring the model to process redundant or less informative frames. The processing of dense animation frames imposes significant training complexity, especially when learning intricate distributions of large motion datasets even with modern neural architectures. This severely limits the performance of generative motion models for downstream tasks. Inspired by professional animators who mainly focus on sparse keyframes, we propose a novel diffusion framework explicitly designed around sparse and geometrically meaningful keyframes. Our method reduces computation by masking non-keyframes and efficiently interpolating missing frames. We dynamically refine the keyframe mask during inference to prioritize informative frames in later diffusion steps. Extensive experiments show that our approach consistently outperforms state-of-the-art methods in text alignment and motion realism, while also effectively maintaining high performance at significantly fewer diffusion steps. We further validate the robustness of our framework by using it as a generative prior and adapting it to different downstream tasks.

📄 PDF Abstract BibTeX arXiv:2503.13859

Code (0)

등록된 구현이 없습니다.

Tasks

Motion GenerationMotion Synthesis

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Enhanced Fine-grained Motion Diffusion for Text-driven Human Motion Synthesis

2023-05-23 · Dong Wei, Xiaoning Sun, Huaijiang Sun, Bin Li 외

The emergence of text-driven motion synthesis technique provides animators with great potential to create efficiently. However, in most cases, textual expressions only contain general and qualitative motion descriptions,…

Motion Synthesisvalid

Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Rendering

2026-01-14 · Jieying Chen, Jeffrey Hu, Joan Lasenby, Ayush Tewari arxiv

Modern video generative models based on diffusion models can produce very realistic clips, but they are computationally inefficient, often requiring minutes of GPU time for just a few seconds of video. This inefficiency …

3D ReconstructionVideo Generation

Flexible Motion In-betweening with Diffusion Models

2024-05-17 · Setareh Cohan, Guy Tevet, Daniele Reda, Xue Bin Peng 외

Motion in-betweening, a fundamental task in character animation, consists of generating motion sequences that plausibly interpolate user-provided keyframe constraints. It has long been recognized as a labor-intensive and…

Imputationmotion in-betweening

Generative Motion In-betweening by Diffusion over Continuous Implicit Representations

2026-05-12 · Shiyu Fan, Paul Henderson, Edmond S. L. Ho arxiv

Recent advances in generative models have yielded impressive progress on motion in-betweening, allowing for more complex, varied, and realistic motion transitions. However, recent methods still exhibit noticeable limitat…

Guided Motion Diffusion for Controllable Human Motion Synthesis

2023-05-21 · ICCV 2023 1 · Korrawe Karunratanakul, Konpat Preechakul, Supasorn Suwajanakorn, Siyu Tang

Denoising diffusion models have shown great promise in human motion synthesis conditioned on natural language descriptions. However, integrating spatial constraints, such as pre-defined motion trajectories and obstacles,…

DenoisingImputationMotion GenerationMotion Synthesis