A Neural Temporal Model for Human Motion Prediction
We propose novel neural temporal models for predicting and synthesizing human motion, achieving state-of-the-art in modeling long-term motion trajectories while being competitive with prior work in short-term prediction and requiring significantly less computation. Key aspects of our proposed system include: 1) a novel, two-level processing architecture that aids in generating planned trajectories, 2) a simple set of easily computable features that integrate derivative information, and 3) a novel multi-objective loss function that helps the model to slowly progress from simple next-step prediction to the harder task of multi-step, closed-loop prediction. Our results demonstrate that these innovations improve the modeling of long-term motion trajectories. Finally, we propose a novel metric, called Normalized Power Spectrum Similarity (NPSS), to evaluate the long-term predictive ability of motion synthesis models, complementing the popular mean-squared error (MSE) measure of Euler joint angles over time. We conduct a user study to determine if the proposed NPSS correlates with human evaluation of long-term motion more strongly than MSE and find that it indeed does. We release code and additional results (visualizations) for this paper at: https://github.com/cr7anand/neural_temporal_models
Code (1)
Tasks
Human motion predictionmodelmotion predictionMotion SynthesisPredictionSimilar Papers 제목 키워드 기반
Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling the sequential data, recent works utilize RNN to model hu…
Human motion predictionmotion predictionMotionWavelet: Human Motion Prediction via Wavelet Manifold Learning
Modeling temporal characteristics and the non-stationary dynamics of body movement plays a significant role in predicting human future motions. However, it is challenging to capture these features due to the subtle trans…
DenoisingHuman motion predictionmotion predictionPredictionMotion Prediction Using Temporal Inception Module
Human motion prediction is a necessary component for many applications in robotics and autonomous driving. Recent methods propose using sequence-to-sequence deep learning models to tackle this problem. However, they do n…
Autonomous DrivingHuman motion predictionmotion predictionPredictionTowards Accurate Human Motion Prediction via Iterative Refinement
Human motion prediction aims to forecast an upcoming pose sequence given a past human motion trajectory. To address the problem, in this work we propose FreqMRN, a human motion prediction framework that takes into accoun…
Human motion predictionHuman Pose Forecastingmotion predictionPredictionTemporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Prediction
Exploring the bridge between historical and future motion behaviors remains a central challenge in human motion prediction. While most existing methods incorporate a reconstruction task as an auxiliary task into the deco…
DecoderHuman motion predictionmotion predictionPrediction