Deep learning-based estimation of whole-body kinematics from multi-view images
It is necessary to analyze the whole-body kinematics (including joint locations and joint angles) to assess risks of fatal and musculoskeletal injuries in occupational tasks. Human pose estimation has gotten more attention in recent years as a method to minimize the errors in determining joint locations. However, the joint angles are not often estimated, nor is the quality of joint angle estimation assessed. In this paper, we presented an end-to-end approach on direct joint angle estimation from multi-view images. Our method leveraged the volumetric pose representation and mapped the rotation representation to a continuous space where each rotation was uniquely represented. We also presented a new kinematic dataset in the domain of residential roofing with a data processing pipeline to generate necessary annotations for the supervised training procedure on direct joint angle estimation. We achieved a mean angle error of $7.19^\circ$ on the new Roofing dataset and $8.41^\circ$ on the Human3.6M dataset, paving the way for employment of on-site kinematic analysis using multi-view images.
Code (1)
Tasks
Pose EstimationSimilar Papers 제목 키워드 기반
Comparative analysis of whole-body center-of-mass estimation methods in dynamic and static activities using marker-based systems
Accurate estimation of the whole-body center of mass (CoM) is essential for assessing human stability and postural control. However, selecting the most accurate estimation method is challenging due to the complexity of h…
State EstimationNeural-Behavioral Representation of Natural Whole-body Movement in Monkeys
Understanding how cortical activity represents natural whole-body behaviors in primates remains challenging. Limited by the diversity of movements and inaccessibility of large-scale neural representation of whole-body ki…
HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recovery
Recovering whole-body mesh by inferring the abstract pose and shape parameters from visual content can obtain 3D bodies with realistic structures. However, the inferring process is highly non-linear and suffers from imag…
3D Human Pose Estimation3D Human ReconstructionKeypoint EstimationKinematics-Aware Diffusion Policy with Consistent 3D Observation and Action Space for Whole-Arm Robotic Manipulation
Whole-body control of robotic manipulators with awareness of full-arm kinematics is crucial for many manipulation scenarios involving body collision avoidance or body-object interactions, which makes it insufficient to c…
Collision Avoidance3D Kinematics Estimation from Video with a Biomechanical Model and Synthetic Training Data
Accurate 3D kinematics estimation of human body is crucial in various applications for human health and mobility, such as rehabilitation, injury prevention, and diagnosis, as it helps to understand the biomechanical load…
Keypoint DetectionMarkerless Motion Capture