Human Body Shape Estimation Using a Multi-Resolution Manifold Forest
This paper proposes a method for estimating the 3D body shape of a person with robustness to clothing. We formulate the problem as optimization over the manifold of valid depth maps of body shapes learned from synthetic training data. The manifold itself is represented using a novel data structure, a Multi-Resolution Manifold Forest (MRMF), which contains vertical edges between tree nodes as well as horizontal edges between nodes across trees that correspond to overlapping partitions. We show that this data structure allows both efficient localization and navigation on the manifold for on-the-fly building of local linear models (manifold charting). We demonstrate shape estimation of clothed users, showing significant improvement in accuracy over global shape models and models using pre-computed clusters. We further compare the MRMF with alternative manifold charting methods on a public dataset for estimating 3D motion from noisy 2D marker observations, obtaining state-of-the-art results.
Code (0)
등록된 구현이 없습니다.
Tasks
validSimilar Papers 제목 키워드 기반
Estimation of 3D Body Shape and Clothing Measurements from Frontal- and Side-view Images
The estimation of 3D human body shape and clothing measurements is crucial for virtual try-on and size recommendation problems in the fashion industry but has always been a challenging problem due to several conditions, …
Virtual Try-onProbabilistic Estimation of 3D Human Shape and Pose with a Semantic Local Parametric Model
This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Some recent approaches to this task predict probability distributions over human body model parameters conditioned on the input…
Pose EstimationA Shape-Aware Total Body Photography System for In-focus Surface Coverage Optimization
Total Body Photography (TBP) is becoming a useful screening tool for patients at high risk for skin cancer. While much progress has been made, existing TBP systems can be further improved for automatic detection and anal…
3D geometryProbabilistic 3D Human Shape and Pose Estimation from Multiple Unconstrained Images in the Wild
This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Recent progress in this field has focused on single images, video or multi-view images as inputs. In contrast, we propose a new…
3D Human Pose Estimation3D Human Shape EstimationMulti-Hypotheses 3D Human Pose EstimationPose Estimation+1Sequential 3D Human Pose and Shape Estimation From Point Clouds
This work addresses the problem of 3D human pose and shape estimation from a sequence of point clouds. Existing sequential 3D human shape estimation methods mainly focus on the template model fitting from a sequence of d…
3D human pose and shape estimation3D Human Shape Estimation