paper-with-me

홈 › Papers

A Brand New Dance Partner: Music-Conditioned Pluralistic Dancing Controlled by Multiple Dance Genres

2022-01-01 · CVPR 2022 1 · Jinwoo Kim, Heeseok Oh, Seongjean Kim, Hoseok Tong, SangHoon Lee

When coming up with phrases of movement, choreographers all have their habits as they are used to their skilled dance genres. Therefore, they tend to return certain patterns of the dance genres that they are familiar with. What if artificial intelligence could be used to help choreographers blend dance genres by suggesting various dances, and one that matches their choreographic style? Numerous task-specific variants of autoregressive networks have been developed for dance generation. Yet, a serious limitation remains that all existing algorithms can return repeated patterns for a given initial pose sequence, which may be inferior. To mitigate this issue, we propose MNET, a novel and scalable approach that can perform music-conditioned pluralistic dance generation synthesized by multiple dance genres using only a single model. Here, we learn a dance-genre aware latent representation by training a conditional generative adversarial network leveraging Transformer architecture. We conduct extensive experiments on AIST++ along with user studies. Compared to the state-of-the-art methods, our method synthesizes plausible and diverse outputs according to multiple dance genres as well as generates outperforming dance sequences qualitatively and quantitatively.

📄 PDF Abstract BibTeX

Code (1)

jw09191/MNET 공식 구현 pytorch

Tasks

Generative Adversarial NetworkMotion Synthesis

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modeling

2025-06-23 · Anindita Ghosh, Bing Zhou, Rishabh Dabral, Jian Wang 외

We present DuetGen, a novel framework for generating interactive two-person dances from music. The key challenge of this task lies in the inherent complexities of two-person dance interactions, where the partners need to…

Motion Synthesis

Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment

2024-03-27 · Li SiYao, Tianpei Gu, Zhitao Yang, Zhengyu Lin 외

We introduce a novel task within the field of 3D dance generation, termed dance accompaniment, which necessitates the generation of responsive movements from a dance partner, the "follower", synchronized with the lead da…

Rhythm

Dance with You: The Diversity Controllable Dancer Generation via Diffusion Models

2023-08-23 · Siyue Yao, MingJie Sun, Bingliang Li, Fengyu Yang 외

Recently, digital humans for interpersonal interaction in virtual environments have gained significant attention. In this paper, we introduce a novel multi-dancer synthesis task called partner dancer generation, which in…

DiversityMotion Generation

Reimagining Dance: Real-time Music Co-creation between Dancers and AI

2025-06-13 · Olga Vechtomova, Jeff Bos

Dance performance traditionally follows a unidirectional relationship where movement responds to music. While AI has advanced in various creative domains, its application in dance has primarily focused on generating chor…

MIDGET: Music Conditioned 3D Dance Generation

2024-04-18 · Jinwu Wang, Wei Mao, Miaomiao Liu

In this paper, we introduce a MusIc conditioned 3D Dance GEneraTion model, named MIDGET based on Dance motion Vector Quantised Variational AutoEncoder (VQ-VAE) model and Motion Generative Pre-Training (GPT) model to gene…

Rhythm