paper-with-me

홈 › Papers

StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Framework

2024-05-09 · Yiheng Huang, Hui Yang, Chuanchen Luo, Yuxi Wang, Shibiao Xu, Zhaoxiang Zhang, Man Zhang, Junran Peng

Thanks to the powerful generative capacity of diffusion models, recent years have witnessed rapid progress in human motion generation. Existing diffusion-based methods employ disparate network architectures and training strategies. The effect of the design of each component is still unclear. In addition, the iterative denoising process consumes considerable computational overhead, which is prohibitive for real-time scenarios such as virtual characters and humanoid robots. For this reason, we first conduct a comprehensive investigation into network architectures, training strategies, and inference processs. Based on the profound analysis, we tailor each component for efficient high-quality human motion generation. Despite the promising performance, the tailored model still suffers from foot skating which is an ubiquitous issue in diffusion-based solutions. To eliminate footskate, we identify foot-ground contact and correct foot motions along the denoising process. By organically combining these well-designed components together, we present StableMoFusion, a robust and efficient framework for human motion generation. Extensive experimental results show that our StableMoFusion performs favorably against current state-of-the-art methods. Project page: https://h-y1heng.github.io/StableMoFusion-page/

📄 PDF Abstract BibTeX arXiv:2405.05691

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingMotion Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Free-T2M: Frequency Enhanced Text-to-Motion Diffusion Model With Consistency Loss

2025-01-30 · Wenshuo Chen, Haozhe Jia, Songning Lai, Keming Wu 외

Rapid progress in text-to-motion generation has been largely driven by diffusion models. However, existing methods focus solely on temporal modeling, thereby overlooking frequency-domain analysis. We identify two key pha…

DenoisingMotion GenerationMotion Synthesis

MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training

2024-06-04 · Kengo Uchida, Takashi Shibuya, Yuhta Takida, Naoki Murata 외

In motion generation, controllability as well as generation quality and speed is becoming more and more important. There are various motion editing tasks, such as in-betweening, upper body editing, and path-following, bu…

Motion GenerationMotion Synthesis

Causal Motion Diffusion Models for Autoregressive Motion Generation

2026-02-26 · Qing Yu, Akihisa Watanabe, Kent Fujiwara arxiv

Recent advances in motion diffusion models have substantially improved the realism of human motion synthesis. However, existing approaches either rely on full-sequence diffusion models with bidirectional generation, whic…

Motion Synthesis

VideoControlNet: A Motion-Guided Video-to-Video Translation Framework by Using Diffusion Model with ControlNet

2023-07-26 · Zhihao Hu, Dong Xu

Recently, diffusion models like StableDiffusion have achieved impressive image generation results. However, the generation process of such diffusion models is uncontrollable, which makes it hard to generate videos with c…

Image Generation

FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generation

2025-12-03 · Yiyi Cai, Yuhan Wu, Kunhang Li, You Zhou 외 arxiv

We present FloodDiffusion, a new framework for text-driven, streaming human motion generation. Given time-varying text prompts, FloodDiffusion generates text-aligned, seamless motion sequences with real-time latency. Unl…