From Kinematics To Dynamics: Estimating Center of Pressure and Base of Support from Video Frames of Human Motion
To gain an understanding of the relation between a given human pose image and the corresponding physical foot pressure of the human subject, we propose and validate two end-to-end deep learning architectures, PressNet and PressNet-Simple, to regress foot pressure heatmaps (dynamics) from 2D human pose (kinematics) derived from a video frame. A unique video and foot pressure data set of 813,050 synchronized pairs, composed of 5-minute long choreographed Taiji movement sequences of 6 subjects, is collected and used for leaving-one-subject-out cross validation. Our initial experimental results demonstrate reliable and repeatable foot pressure prediction from a single image, setting the first baseline for such a complex cross modality mapping problem in computer vision. Furthermore, we compute and quantitatively validate the Center of Pressure (CoP) and Base of Support (BoS) from predicted foot pressure distribution, obtaining key components in pose stability analysis from images with potential applications in kinesiology, medicine, sports and robotics.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Learning Dynamics from Kinematics: Estimating 2D Foot Pressure Maps from Video Frames
Pose stability analysis is the key to understanding locomotion and control of body equilibrium, with applications in numerous fields such as kinesiology, medicine, and robotics. In biomechanics, Center of Pressure (CoP) …
From Image to Stability: Learning Dynamics from Human Pose
We propose and validate two end-to-end deep learning architectures to learn foot pressure distribution maps (dynamics) from 2D or 3D human pose (kinematics). The networks are trained using 1.36 million synchronized pose+…
Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensors
We propose Ground Reaction Inertial Poser (GRIP), a method that reconstructs physically plausible human motion using four wearable devices. Unlike conventional IMU-only approaches, GRIP combines IMU signals with foot pre…
FootFormer: Estimating Stability from Visual Input
We propose FootFormer, a cross-modality approach for jointly predicting human motion dynamics directly from visual input. On multiple datasets, FootFormer achieves statistically significantly better or equivalent estimat…
Modulation of the cardiomyocyte contraction inside a hydrostatic pressure bioreactor: $\textit{in vitro}$ verification of the Frank-Starling law
We have studied beating mouse cardiac syncytia $\textit{in vitro}$ in order to assess the inotropic, ergotropic, and chronotropic effects of both increasing and decreasing hydrostatic pressures. In particular, we have pe…