Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation

2024-07-15 · Peng Jin, Hao Li, Zesen Cheng, Kehan Li, Runyi Yu, Chang Liu, Xiangyang Ji, Li Yuan, Jie Chen

Text-to-motion generation requires not only grounding local actions in language but also seamlessly blending these individual actions to synthesize diverse and realistic global motions. However, existing motion generation methods primarily focus on the direct synthesis of global motions while neglecting the importance of generating and controlling local actions. In this paper, we propose the local action-guided motion diffusion model, which facilitates global motion generation by utilizing local actions as fine-grained control signals. Specifically, we provide an automated method for reference local action sampling and leverage graph attention networks to assess the guiding weight of each local action in the overall motion synthesis. During the diffusion process for synthesizing global motion, we calculate the local-action gradient to provide conditional guidance. This local-to-global paradigm reduces the complexity associated with direct global motion generation and promotes motion diversity via sampling diverse actions as conditions. Extensive experiments on two human motion datasets, i.e., HumanML3D and KIT, demonstrate the effectiveness of our method. Furthermore, our method provides flexibility in seamlessly combining various local actions and continuous guiding weight adjustment, accommodating diverse user preferences, which may hold potential significance for the community. The project page is available at https://jpthu17.github.io/GuidedMotion-project/.

📄 PDF Abstract BibTeX arXiv:2407.10528

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionMotion GenerationMotion Synthesis

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Focus 설명 없음

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

THOR: Text to Human-Object Interaction Diffusion via Relation Intervention

2024-03-17 · Qianyang Wu, Ye Shi, Xiaoshui Huang, Jingyi Yu 외

This paper addresses new methodologies to deal with the challenging task of generating dynamic Human-Object Interactions from textual descriptions (Text2HOI). While most existing works assume interactions with limited bo…

Diversity Human-Object Interaction Detection Object Relation

Empathetic Motion Generation for Humanoid Educational Robots via Reasoning-Guided Vision--Language--Motion Diffusion Architecture

2026-03-19 · Fuze Sun, Lingyu Li, Lekan Dai, Xinyu Fan arxiv

This article suggests a reasoning-guided vision-language-motion diffusion framework (RG-VLMD) for generating instruction-aware co-speech gestures for humanoid robots in educational scenarios. The system integrates multi-…

Motion Synthesis

InterEdit: Navigating Text-Guided 3D Dyadic Human Motion Editing

2026-03-13 · Yebin Yang, Di Wen, Lei Qi, Weitong Kong 외 arxiv

Text-guided 3D motion editing has seen success in single-person scenarios, but its extension to multi-person settings is less explored due to limited paired data and the complexity of inter-person interactions. We introd…

LaMoGen: Laban Movement-Guided Diffusion for Text-to-Motion Generation

2025-09-29 · Heechang Kim, Gwanghyun Kim, Se Young Chun arxiv

Diverse human motion generation is an increasingly important task, having various applications in computer vision, human-computer interaction and animation. While text-to-motion synthesis using diffusion models has shown…