Character Controllers Using Motion VAEs
A fundamental problem in computer animation is that of realizing purposeful and realistic human movement given a sufficiently-rich set of motion capture clips. We learn data-driven generative models of human movement using autoregressive conditional variational autoencoders, or Motion VAEs. The latent variables of the learned autoencoder define the action space for the movement and thereby govern its evolution over time. Planning or control algorithms can then use this action space to generate desired motions. In particular, we use deep reinforcement learning to learn controllers that achieve goal-directed movements. We demonstrate the effectiveness of the approach on multiple tasks. We further evaluate system-design choices and describe the current limitations of Motion VAEs.
Code (1)
Tasks
Continuous ControlDeep Reinforcement LearningMotion Synthesisreinforcement-learningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllers
Humans excel in navigating diverse, complex environments with agile motor skills, exemplified by parkour practitioners performing dynamic maneuvers, such as climbing up walls and jumping across gaps. Reproducing these ag…
SFV: Reinforcement Learning of Physical Skills from Videos
Data-driven character animation based on motion capture can produce highly naturalistic behaviors and, when combined with physics simulation, can provide for natural procedural responses to physical perturbations, enviro…
Deep Reinforcement LearningPose Estimationreinforcement-learningReinforcement Learning+1Variational Autoencoders for Learning Latent Representations of Speech Emotion: A Preliminary Study
Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, genera…
Emotion ClassificationEmotion RecognitionGeneral ClassificationSpeech Emotion RecognitionGPC: Large-Scale Generative Pretraining for Transferable Motor Control
Developing controllers capable of completing a wide range of tasks in a natural and life-like manner is a key challenge in enabling practical applications of physics-based character animation. In this work, we introduce …
Reinforcement LearningComposing Diverse Policies for Temporally Extended Tasks
Robot control policies for temporally extended and sequenced tasks are often characterized by discontinuous switches between different local dynamics. These change-points are often exploited in hierarchical motion planni…
Hierarchical Reinforcement LearningMotion Planning