paper-with-me

Papers

Kimodo: Scaling Controllable Human Motion Generation

2026-03-16 · Davis Rempe, Mathis Petrovich, Ye Yuan, Haotian Zhang, Xue Bin Peng, Yifeng Jiang, Tingwu Wang, Umar Iqbal, David Minor, Michael de Ruyter, Jiefeng Li, Chen Tessler, Edy Lim, Eugene Jeong, Sam Wu, Ehsan Hassani, Michael Huang, Jin-Bey Yu, Chaeyeon Chung, Lina Song, Olivier Dionne, Jan Kautz, Simon Yuen, Sanja Fidler arxiv

High-quality human motion data is becoming increasingly important for applications in robotics, simulation, and entertainment. Recent generative models offer a potential data source, enabling human motion synthesis through intuitive inputs like text prompts or kinematic constraints on poses. However, the small scale of public mocap datasets has limited the motion quality, control accuracy, and generalization of these models. In this work, we introduce Kimodo, an expressive and controllable kinematic motion diffusion model trained on 700 hours of optical motion capture data. Our model generates high-quality motions while being easily controlled through text and a comprehensive suite of kinematic constraints including full-body keyframes, sparse joint positions/rotations, 2D waypoints, and dense 2D paths. This is enabled through a carefully designed motion representation and two-stage denoiser architecture that decomposes root and body prediction to minimize motion artifacts while allowing for flexible constraint conditioning. Experiments on the large-scale mocap dataset justify key design decisions and analyze how the scaling of dataset size and model size affect performance.

📄 PDF Abstract BibTeX arXiv:2603.15546

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Synthesis

Similar Papers 제목 키워드 기반

Controllable Affective Generation via Latent Vector Steering

2026-08-26 · Xixian Yong, Siyuan Chang, Yingying Zhang, Xian Wu 외 arxiv

Large Language Models (LLMs) often produce emotionally flattened responses after alignment, limiting their effectiveness in affect-sensitive applications. In this paper, we propose EmoVec, a lightweight framework for con…

Continuous Control

Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling

2026-06-25 · Yiwen Yan, Wanning He, Yu-Wing Tai arxiv

Human motion generation models are fundamentally constrained by the limited diversity of motion capture datasets, which predominantly contain common, repetitive actions and fail to cover the long tail of complex human mo…

Representation LearningMotion Synthesis

MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model

2024-05-30 · Muyao Niu, Xiaodong Cun, Xintao Wang, Yong Zhang 외

We present MOFA-Video, an advanced controllable image animation method that generates video from the given image using various additional controllable signals (such as human landmarks reference, manual trajectories, and …

Image AnimationVideo Generation

Exploring the Role of Synthetic Data Augmentation in Controllable Human-Centric Video Generation

2026-04-23 · Yuanchen Fei, Yude Zou, Zejian Kang, Ming Li 외 arxiv

Controllable human video generation aims to produce realistic videos of humans with explicitly guided motions and appearances,serving as a foundation for digital humans, animation, and embodied AI.However, the scarcity o…

Data AugmentationVideo Generation

MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model

2024-04-30 · Wenxun Dai, Ling-Hao Chen, Jingbo Wang, Jinpeng Liu 외

This work introduces MotionLCM, extending controllable motion generation to a real-time level. Existing methods for spatial-temporal control in text-conditioned motion generation suffer from significant runtime inefficie…

Motion GenerationMotion Synthesis