Probabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wild
This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Recent progress in this field has focused on single images, video or multi-view images as inputs. In contrast, we propose a new task: shape and pose estimation from a group of multiple images of a human subject, without constraints on subject pose, camera viewpoint or background conditions between images in the group. Our solution to this task predicts distributions over SMPL body shape and pose parameters conditioned on the input images in the group. We probabilistically combine predicted body shape distributions from each image to obtain a final multi-image shape prediction. We show that the additional body shape information present in multi-image input groups improves 3D human shape estimation metrics compared to single-image inputs on the SSP-3D dataset and a private dataset of tape-measured humans. In addition, predicting distributions over 3D bodies allows us to quantify pose prediction uncertainty, which is useful when faced with challenging input images with significant occlusion. Our method demonstrates meaningful pose uncertainty on the 3DPW dataset and is competitive with the state-of-the-art in terms of pose estimation metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose Estimation3D Human Shape EstimationMulti-Hypotheses 3D Human Pose EstimationPose EstimationPose PredictionSimilar Papers 제목 키워드 기반
Probabilistic Estimation of 3D Human Shape and Pose with a Semantic Local Parametric Model
This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Some recent approaches to this task predict probability distributions over human body model parameters conditioned on the input…
Pose EstimationTAPE: Temporal Attention-based Probabilistic human pose and shape Estimation
Reconstructing 3D human pose and shape from monocular videos is a well-studied but challenging problem. Common challenges include occlusions, the inherent ambiguities in the 2D to 3D mapping and the computational complex…
3D Human Pose EstimationHierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wild
This paper addresses the problem of 3D human body shape and pose estimation from an RGB image. This is often an ill-posed problem, since multiple plausible 3D bodies may match the visual evidence present in the input - p…
3D Human Pose Estimation3D Human Shape Estimation3D ReconstructionMulti-Hypotheses 3D Human Pose Estimation+1Real-time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera
In this paper we present a novel real-time algorithm for simultaneous pose and shape estimation for articulated objects, such as human beings and animals. The key of our pose estimation component is to embed the articula…
Pose EstimationHuManiFlow: Ancestor-Conditioned Normalising Flows on SO(3) Manifolds for Human Pose and Shape Distribution Estimation
Monocular 3D human pose and shape estimation is an ill-posed problem since multiple 3D solutions can explain a 2D image of a subject. Recent approaches predict a probability distribution over plausible 3D pose and shape …
3D human pose and shape estimation3D Human Pose EstimationDiversityMulti-Hypotheses 3D Human Pose Estimation+1