paper-with-me

홈 › Papers

Towards Robust and Controllable Text-to-Motion via Masked Autoregressive Diffusion

2025-05-16 · Zongye Zhang, Bohan Kong, Qingjie Liu, Yunhong Wang

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution motions, limiting their applicability in real-world scenarios. Existing VQVAE-based methods often fail to represent novel motions faithfully using discrete tokens, which hampers their ability to generalize beyond seen data. Meanwhile, diffusion-based methods operating on continuous representations often lack fine-grained control over individual frames. To address these challenges, we propose a robust motion generation framework MoMADiff, which combines masked modeling with diffusion processes to generate motion using frame-level continuous representations. Our model supports flexible user-provided keyframe specification, enabling precise control over both spatial and temporal aspects of motion synthesis. MoMADiff demonstrates strong generalization capability on novel text-to-motion datasets with sparse keyframes as motion prompts. Extensive experiments on two held-out datasets and two standard benchmarks show that our method consistently outperforms state-of-the-art models in motion quality, instruction fidelity, and keyframe adherence.

📄 PDF Abstract BibTeX arXiv:2505.11013

Code (0)

등록된 구현이 없습니다.

Tasks

Motion GenerationMotion Synthesis

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Controllable Motion Synthesis and Reconstruction with Autoregressive Diffusion Models

2023-04-03 · Wenjie Yin, Ruibo Tu, Hang Yin, Danica Kragic 외

Data-driven and controllable human motion synthesis and prediction are active research areas with various applications in interactive media and social robotics. Challenges remain in these fields for generating diverse mo…

DecoderMotion Synthesis

Real-Time Motion-Controllable Autoregressive Video Diffusion

2025-10-09 · Kesen Zhao, Jiaxin Shi, Beier Zhu, Junbao Zhou 외 arxiv

Real-time motion-controllable video generation remains challenging due to the inherent latency of bidirectional diffusion models and the lack of effective autoregressive (AR) approaches. Existing AR video diffusion model…

Text-to-Video GenerationReinforcement Learning

BAMM: Bidirectional Autoregressive Motion Model

2024-03-28 · Ekkasit Pinyoanuntapong, Muhammad Usama Saleem, Pu Wang, Minwoo Lee 외

Generating human motion from text has been dominated by denoising motion models either through diffusion or generative masking process. However, these models face great limitations in usability by requiring prior knowled…

DenoisingmodelMotion GenerationMotion Synthesis

Text-driven Human Motion Generation with Motion Masked Diffusion Model

2024-09-29 · Xingyu Chen

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, wh…

DiversityMotion Generation

DiMo: Discrete Diffusion Modeling for Motion Generation and Understanding

2026-02-04 · Ning Zhang, Zhengyu Li, Kwong Weng Loh, Mingxi Xu 외 arxiv

Prior masked modeling motion generation methods predominantly study text-to-motion. We present DiMo, a discrete diffusion-style framework, which extends masked modeling to bidirectional text--motion understanding and gen…