paper-with-me

홈 › Papers

Recovering 3D Human Mesh from Monocular Images: A Survey

2022-03-03 · Yating Tian, Hongwen Zhang, Yebin Liu, LiMin Wang

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining well-aligned and physically plausible mesh results, two paradigms have been developed to overcome challenges in the 2D-to-3D lifting process: i) an optimization-based paradigm, where different data terms and regularization terms are exploited as optimization objectives; and ii) a regression-based paradigm, where deep learning techniques are embraced to solve the problem in an end-to-end fashion. Meanwhile, continuous efforts are devoted to improving the quality of 3D mesh labels for a wide range of datasets. Though remarkable progress has been achieved in the past decade, the task is still challenging due to flexible body motions, diverse appearances, complex environments, and insufficient in-the-wild annotations. To the best of our knowledge, this is the first survey that focuses on the task of monocular 3D human mesh recovery. We start with the introduction of body models and then elaborate recovery frameworks and training objectives by providing in-depth analyses of their strengths and weaknesses. We also summarize datasets, evaluation metrics, and benchmark results. Open issues and future directions are discussed in the end, hoping to motivate researchers and facilitate their research in this area. A regularly updated project page can be found at https://github.com/tinatiansjz/hmr-survey.

📄 PDF Abstract BibTeX arXiv:2203.01923

Code (1)

tinatiansjz/hmr-survey 공식 구현

Tasks

3D human pose and shape estimationHuman Mesh RecoverySurvey

Similar Papers 제목 키워드 기반

Temporally Coherent Full 3D Mesh Human Pose Recovery from Monocular Video

2019-06-01 · Jian Liu, Naveed Akhtar, Ajmal Mian

Advances in Deep Learning have recently made it possible to recover full 3D meshes of human poses from individual images. However, extension of this notion to videos for recovering temporally coherent poses still remains…

Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representation

2019-08-20 · ICCV 2019 10 · Sun Yu, Ye Yun, Liu Wu, Gao Wenpeng 외

We describe an end-to-end method for recovering 3D human body mesh from single images and monocular videos. Different from the existing methods try to obtain all the complex 3D pose, shape, and camera parameters from one…

3D Human Pose Estimation3D Pose EstimationHuman Mesh Recovery

POTTER: Pooling Attention Transformer for Efficient Human Mesh Recovery

2023-03-23 · CVPR 2023 1 · Ce Zheng, Xianpeng Liu, Guo-Jun Qi, Chen Chen

Transformer architectures have achieved SOTA performance on the human mesh recovery (HMR) from monocular images. However, the performance gain has come at the cost of substantial memory and computational overhead. A ligh…

3D Human Pose EstimationHuman Mesh Recovery

End-to-end Hand Mesh Recovery from a Monocular RGB Image

2019-02-25 · ICCV 2019 10 · Xiong Zhang, Qiang Li, Hong Mo, Wenbo Zhang 외

In this paper, we present a HAnd Mesh Recovery (HAMR) framework to tackle the problem of reconstructing the full 3D mesh of a human hand from a single RGB image. In contrast to existing research on 2D or 3D hand pose est…

3D Hand Pose EstimationHand Pose EstimationPose Estimation

PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Images

2022-07-13 · Hongwen Zhang, Yating Tian, Yuxiang Zhang, Mengcheng Li 외

We present PyMAF-X, a regression-based approach to recovering parametric full-body models from monocular images. This task is very challenging since minor parametric deviation may lead to noticeable misalignment between …

3D human pose and shape estimation3D Human Pose EstimationHuman Mesh RecoveryMarkerless Motion Capture+1