Back to the Future: Joint Aware Temporal Deep Learning 3D Human Pose Estimation
We propose a new deep learning network that introduces a deeper CNN channel filter and constraints as losses to reduce joint position and motion errors for 3D video human body pose estimation. Our model outperforms the previous best result from the literature based on mean per-joint position error, velocity error, and acceleration errors on the Human 3.6M benchmark corresponding to a new state-of-the-art mean error reduction in all protocols and motion metrics. Mean per joint error is reduced by 1%, velocity error by 7% and acceleration by 13% compared to the best results from the literature. Our contribution increasing positional accuracy and motion smoothness in video can be integrated with future end to end networks without increasing network complexity. Our model and code are available at https://vnmr.github.io/ Keywords: 3D, human, image, pose, action, detection, object, video, visual, supervised, joint, kinematic
Code (1)
Tasks
3D Human Pose EstimationAction DetectionPose EstimationPositionSimilar Papers 제목 키워드 기반
Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling the sequential data, recent works utilize RNN to model hu…
Human motion predictionmotion prediction3D Human Pose Estimation With Spatio-Temporal Criss-Cross Attention
Recent transformer-based solutions have shown great success in 3D human pose estimation. Nevertheless, to calculate the joint-to-joint affinity matrix, the computational cost has a quadratic growth with the increasin…
3D Human Pose EstimationPose EstimationDynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language Recognition
Skeleton-aware sign language recognition (SLR) has gained popularity due to its ability to remain unaffected by background information and its lower computational requirements. Current methods utilize spatial graph modul…
Human DynamicsSign Language RecognitionNCSTR: Node-Centric Decoupled Spatio-Temporal Reasoning for Video-based Human Pose Estimation
Video-based human pose estimation remains challenged by motion blur, occlusion, and complex spatiotemporal dynamics. Existing methods often rely on heatmaps or implicit spatio-temporal feature aggregation, which limits j…
Pose EstimationPredicting the Future: A Jointly Learnt Model for Action Anticipation
Inspired by human neurological structures for action anticipation, we present an action anticipation model that enables the prediction of plausible future actions by forecasting both the visual and temporal future. In co…
Action AnticipationGenerative Adversarial Network