From Image to Stability: Learning Dynamics from Human Pose
We propose and validate two end-to-end deep learning architectures to learn foot pressure distribution maps (dynamics) from 2D or 3D human pose (kinematics). The networks are trained using 1.36 million synchronized pose+pressure data pairs from 10 subjects performing multiple takes of a 5-minute long choreographed Taiji sequence. Using leave-one-subject-out cross validation, we demonstrate reliable and repeatable foot pressure prediction, setting the first baseline for solving a non-obvious pose to pressure cross-modality mapping problem in computer vision. Furthermore, we compute and quantitatively validate Center of Pressure (CoP) and Base of Support (BoS), two key components for stability analysis, from the predicted foot pressure distributions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Scale-Dependent Semantic Dynamics Revealed by Allan Deviation
While language progresses through a sequence of semantic states, the underlying dynamics of this progression remain elusive. Here, we treat the semantic progression of written text as a stochastic trajectory in a high-di…
A model for the dynamics of COVID-19 infection transmission in human with latent delay
In this research, we have derived a mathematical model for within human dynamics of COVID-19 infection using delay differential equations. The new model considers a 'latent period' and 'the time for immune response' as d…
Human DynamicsUnityThe stability of 3 transmembrane and 4 transmembrane human vitamin K epoxide reductase models
3 transmembrane and 4 transmembrane helices models are suggested for the human vitamin K epoxide reductase (VKOR). In this study, we investigate the stability of the human 3 transmembrane/4 transmembrane VKOR models empl…
From Kinematics To Dynamics: Estimating Center of Pressure and Base of Support from Video Frames of Human Motion
To gain an understanding of the relation between a given human pose image and the corresponding physical foot pressure of the human subject, we propose and validate two end-to-end deep learning architectures, PressNet an…
HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions
We present HSImul3R, a unified framework for simulation-ready 3D reconstruction of human-scene interactions (HSI) from casual captures, including sparse-view images and monocular videos. Existing methods suffer from a pe…
Reinforcement Learning3D Reconstruction