Motion Puzzle: Arbitrary Motion Style Transfer by Body Part
This paper presents Motion Puzzle, a novel motion style transfer network that advances the state-of-the-art in several important respects. The Motion Puzzle is the first that can control the motion style of individual body parts, allowing for local style editing and significantly increasing the range of stylized motions. Designed to keep the human's kinematic structure, our framework extracts style features from multiple style motions for different body parts and transfers them locally to the target body parts. Another major advantage is that it can transfer both global and local traits of motion style by integrating the adaptive instance normalization and attention modules while keeping the skeleton topology. Thus, it can capture styles exhibited by dynamic movements, such as flapping and staggering, significantly better than previous work. In addition, our framework allows for arbitrary motion style transfer without datasets with style labeling or motion pairing, making many publicly available motion datasets available for training. Our framework can be easily integrated with motion generation frameworks to create many applications, such as real-time motion transfer. We demonstrate the advantages of our framework with a number of examples and comparisons with previous work.
Code (1)
Tasks
Motion GenerationMotion Style TransferMotion SynthesisStyle TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AStF: Motion Style Transfer via Adaptive Statistics Fusor
Human motion style transfer allows characters to appear less rigidity and more realism with specific style. Traditional arbitrary image style transfer typically process mean and variance which is proved effective. Meanwh…
Style TransferArbitrary Motion Style Transfer with Multi-condition Motion Latent Diffusion Model
Computer animation's quest to bridge content and style has historically been a challenging venture with previous efforts often leaning toward one at the expense of the other. This paper tackles the inherent challenge…
Motion Style TransferStyle TransferStyle-ERD: Responsive and Coherent Online Motion Style Transfer
Motion style transfer is a common method for enriching character animation. Motion style transfer algorithms are often designed for offline settings where motions are processed in segments. However, for online animation …
DecoderMotion Style TransferStyle TransferUnpaired Motion Style Transfer from Video to Animation
Transferring the motion style from one animation clip to another, while preserving the motion content of the latter, has been a long-standing problem in character animation. Most existing data-driven approaches are super…
3D ReconstructionMotion Style TransferMotion SynthesisStyle TransferAdversarial Motion Priors Make Good Substitutes for Complex Reward Functions
Training a high-dimensional simulated agent with an under-specified reward function often leads the agent to learn physically infeasible strategies that are ineffective when deployed in the real world. To mitigate these …