On human motion prediction using recurrent neural networks
Human motion modelling is a classical problem at the intersection of graphics and computer vision, with applications spanning human-computer interaction, motion synthesis, and motion prediction for virtual and augmented reality. Following the success of deep learning methods in several computer vision tasks, recent work has focused on using deep recurrent neural networks (RNNs) to model human motion, with the goal of learning time-dependent representations that perform tasks such as short-term motion prediction and long-term human motion synthesis. We examine recent work, with a focus on the evaluation methodologies commonly used in the literature, and show that, surprisingly, state-of-the-art performance can be achieved by a simple baseline that does not attempt to model motion at all. We investigate this result, and analyze recent RNN methods by looking at the architectures, loss functions, and training procedures used in state-of-the-art approaches. We propose three changes to the standard RNN models typically used for human motion, which result in a simple and scalable RNN architecture that obtains state-of-the-art performance on human motion prediction.
Code (8)
Tasks
Human motion predictionHuman Pose ForecastingMotion Estimationmotion predictionMotion SynthesisPredictionSimilar Papers 제목 키워드 기반
Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling the sequential data, recent works utilize RNN to model hu…
Human motion predictionmotion predictionPrediction of Human Full-Body Movements with Motion Optimization and Recurrent Neural Networks
Human movement prediction is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose a prediction framework that …
motion predictionPredictionSequence Modeling using Gated Recurrent Neural Networks
In this paper, we have used Recurrent Neural Networks to capture and model human motion data and generate motions by prediction of the next immediate data point at each time-step. Our RNN is armed with recently proposed …
Machine TranslationSpeech SynthesisTranslationCross-Conditioned Recurrent Networks for Long-Term Synthesis of Inter-Person Human Motion Interactions
Modeling dynamics of human motion is one of the most challenging sequence modeling problem, with diverse applications in animation industry, human-robot interaction, motion-based surveillance, etc. Available attempts to …
DecoderMotion Generationmotion predictionMotion Synthesis+1Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamic
Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the histor…
Human motion predictionmotion predictionPrediction