Everybody Dance Now
This paper presents a simple method for "do as I do" motion transfer: given a source video of a person dancing, we can transfer that performance to a novel (amateur) target after only a few minutes of the target subject performing standard moves. We approach this problem as video-to-video translation using pose as an intermediate representation. To transfer the motion, we extract poses from the source subject and apply the learned pose-to-appearance mapping to generate the target subject. We predict two consecutive frames for temporally coherent video results and introduce a separate pipeline for realistic face synthesis. Although our method is quite simple, it produces surprisingly compelling results (see video). This motivates us to also provide a forensics tool for reliable synthetic content detection, which is able to distinguish videos synthesized by our system from real data. In addition, we release a first-of-its-kind open-source dataset of videos that can be legally used for training and motion transfer.
Code (14)
Tasks
Face GenerationImage-to-Image TranslationVideo GenerationSimilar Papers 제목 키워드 기반
EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animation
Consistent pose-driven character animation has achieved remarkable progress in single-character scenarios. However, extending these advances to multi-character settings is non-trivial, especially when position swap is in…
KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance Art
Digitally synthesizing human motion is an inherently complex process, which can create obstacles in application areas such as virtual reality. We offer a new approach for predicting human motion, KP-RNN, a neural network…
Human motion predictionImage-to-Image TranslationMotion Generationmotion prediction+3Making historical texts accessible to everybody
How Much Income Inequality Is Too Much?
We propose a highly schematic economic model in which, in some cases, wage inequalities lead to higher overall social welfare. This is due to the fact that high earners can consume low productivity, non essential product…
Learning to agree over large state spaces
We study how a consensus emerges in a finite population of like-minded individuals who are asymmetrically informed about the realization of the true state of the world. Agents observe a private signal about the state and…