paper-with-me

홈 › Papers

Two-in-One: Unified Multi-Person Interactive Motion Generation by Latent Diffusion Transformer

2024-12-21 · Boyuan Li, Xihua Wang, Ruihua Song, Wenbing Huang

Multi-person interactive motion generation, a critical yet under-explored domain in computer character animation, poses significant challenges such as intricate modeling of inter-human interactions beyond individual motions and generating two motions with huge differences from one text condition. Current research often employs separate module branches for individual motions, leading to a loss of interaction information and increased computational demands. To address these challenges, we propose a novel, unified approach that models multi-person motions and their interactions within a single latent space. Our approach streamlines the process by treating interactive motions as an integrated data point, utilizing a Variational AutoEncoder (VAE) for compression into a unified latent space, and performing a diffusion process within this space, guided by the natural language conditions. Experimental results demonstrate our method's superiority over existing approaches in generation quality, performing text condition in particular when motions have significant asymmetry, and accelerating the generation efficiency while preserving high quality.

📄 PDF Abstract BibTeX arXiv:2412.16670

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Unified Multi-Modal Interactive & Reactive 3D Motion Generation via Rectified Flow

2025-09-28 · Prerit Gupta, Shourya Verma, Ananth Grama, Aniket Bera arxiv

Generating realistic, context-aware two-person motion conditioned on diverse modalities remains a fundamental challenge for graphics, animation and embodied AI systems. Real-world applications such as VR/AR companions, s…

VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models

2025-03-27 · CVPR 2025 1 · Chi-Pin Huang, Yen-Siang Wu, Hung-Kai Chung, Kai-Po Chang 외

Customized text-to-video generation aims to produce high-quality videos that incorporate user-specified subject identities or motion patterns. However, existing methods mainly focus on personalizing a single concept, eit…

Text-to-Video GenerationVideo Generation

It Takes Two: Real-time Co-Speech Two-person's Interaction Generation via Reactive Auto-regressive Diffusion Model

2024-12-03 · Mingyi Shi, Dafei Qin, Leo Ho, Zhouyingcheng Liao 외

Conversational scenarios are very common in real-world settings, yet existing co-speech motion synthesis approaches often fall short in these contexts, where one person's audio and gestures will influence the other's res…

Motion GenerationMotion Synthesis

DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modeling

2025-06-23 · Anindita Ghosh, Bing Zhou, Rishabh Dabral, Jian Wang 외

We present DuetGen, a novel framework for generating interactive two-person dances from music. The key challenge of this task lies in the inherent complexities of two-person dance interactions, where the partners need to…

Motion Synthesis

InterSyn: Interleaved Learning for Dynamic Motion Synthesis in the Wild

2025-08-14 · Yiyi Ma, Yuanzhi Liang, Xiu Li, Chi Zhang 외 arxiv

We present Interleaved Learning for Motion Synthesis (InterSyn), a novel framework that targets the generation of realistic interaction motions by learning from integrated motions that consider both solo and multi-person…

Motion Synthesis