Generating Multiple Diverse Hypotheses for Human 3D Pose Consistent with 2D Joint Detections
We propose a method to generate multiple diverse and valid human pose hypotheses in 3D all consistent with the 2D detection of joints in a monocular RGB image. We use a novel generative model uniform (unbiased) in the space of anatomically plausible 3D poses. Our model is compositional (produces a pose by combining parts) and since it is restricted only by anatomical constraints it can generalize to every plausible human 3D pose. Removing the model bias intrinsically helps to generate more diverse 3D pose hypotheses. We argue that generating multiple pose hypotheses is more reasonable than generating only a single 3D pose based on the 2D joint detection given the depth ambiguity and the uncertainty due to occlusion and imperfect 2D joint detection. We hope that the idea of generating multiple consistent pose hypotheses can give rise to a new line of future work that has not received much attention in the literature. We used the Human3.6M dataset for empirical evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose EstimationvalidSimilar Papers 제목 키워드 기반
Generating Diverse Hypotheses for Inductive Reasoning
Inductive reasoning - the process of inferring general rules from a small number of observations - is a fundamental aspect of human intelligence. Recent works suggest that large language models (LLMs) can engage in induc…
DiversityGenerating Multiple Hypotheses for 3D Human Pose Estimation with Mixture Density Network
3D human pose estimation from a monocular image or 2D joints is an ill-posed problem because of depth ambiguity and occluded joints. We argue that 3D human pose estimation from a monocular input is an inverse problem whe…
3D Human Pose EstimationMonocular 3D Human Pose EstimationMulti-Hypotheses 3D Human Pose EstimationPose EstimationWeakly Supervised Generative Network for Multiple 3D Human Pose Hypotheses
3D human pose estimation from a single image is an inverse problem due to the inherent ambiguity of the missing depth. Several previous works addressed the inverse problem by generating multiple hypotheses. However, thes…
3D Human Pose EstimationMulti-Hypotheses 3D Human Pose EstimationPose EstimationGEAR: A General Evaluation Framework for Abductive Reasoning
Since the advent of large language models (LLMs), research has focused on instruction following and deductive reasoning. A central question remains: can these models discover new knowledge, and how can we evaluate this a…
Instruction FollowingSnapPose3D: Diffusion-Based Single-Frame 2D-to-3D Lifting of Human Poses
Depth ambiguity and joint uncertainty are the two main obstacles in obtaining accurate human pose predictions by 2D-to-3D lifting methods proposed in the literature. In particular, these issues are caused by 2D joint loc…
3D Human Pose EstimationTemporal Sequences