Deep Kinematic Pose Regression
Learning articulated object pose is inherently difficult because the pose is high dimensional but has many structural constraints. Most existing work do not model such constraints and does not guarantee the geometric validity of their pose estimation, therefore requiring a post-processing to recover the correct geometry if desired, which is cumbersome and sub-optimal. In this work, we propose to directly embed a kinematic object model into the deep neutral network learning for general articulated object pose estimation. The kinematic function is defined on the appropriately parameterized object motion variables. It is differentiable and can be used in the gradient descent based optimization in network training. The prior knowledge on the object geometric model is fully exploited and the structure is guaranteed to be valid. We show convincing experiment results on a toy example and the 3D human pose estimation problem. For the latter we achieve state-of-the-art result on Human3.6M dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose EstimationObjectPose EstimationregressionvalidSimilar Papers 제목 키워드 기반
KinEMbed: Decoding Kinematics from Electromyography via Cross-Modal Contrastive Learning
Decoding hand kinematics from surface electromyography (EMG) is a core challenge in wearable biosignal processing with clinical relevance for prosthetic control and motor rehabilitation. Most representation learning appr…
Representation LearningContrastive LearningIs the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regression
We demonstrate the use of symbolic regression in deriving analytical formulas, which are needed at various stages of a typical experimental analysis in collider phenomenology. As a first application, we consider kinemati…
regressionSymbolic RegressionKinematics clustering enables head impact subtyping for better traumatic brain injury prediction
Traumatic brain injury can be caused by various types of head impacts. However, due to different kinematic characteristics, many brain injury risk estimation models are not generalizable across the variety of impacts tha…
Car RacingClusteringInjury PredictionregressionThe Road to Learning Explainable Inverse Kinematic Models: Graph Neural Networks as Inductive Bias for Symbolic Regression
This paper shows how a Graph Neural Network (GNN) can be used to learn an Inverse Kinematics (IK) based on an automatically generated dataset. The generated Inverse Kinematics is generalized to a family of manipulators w…
Graph Neural NetworkInductive BiasSymbolic RegressionExplaining human body responses in random vibration: Effect of motion direction, sitting posture, and anthropometry
This study investigates the effects of anthropometric attributes, biological sex, and posture on translational body kinematic responses in translational vibrations. In total, 35 participants were recruited. Perturbations…
regression