paper-with-me

홈 › Papers

Self-supervised 3D Human Pose Estimation from a Single Image

2023-04-05 · Jose Sosa, David Hogg

We propose a new self-supervised method for predicting 3D human body pose from a single image. The prediction network is trained from a dataset of unlabelled images depicting people in typical poses and a set of unpaired 2D poses. By minimising the need for annotated data, the method has the potential for rapid application to pose estimation of other articulated structures (e.g. animals). The self-supervision comes from an earlier idea exploiting consistency between predicted pose under 3D rotation. Our method is a substantial advance on state-of-the-art self-supervised methods in training a mapping directly from images, without limb articulation constraints or any 3D empirical pose prior. We compare performance with state-of-the-art self-supervised methods using benchmark datasets that provide images and ground-truth 3D pose (Human3.6M, MPI-INF-3DHP). Despite the reduced requirement for annotated data, we show that the method outperforms on Human3.6M and matches performance on MPI-INF-3DHP. Qualitative results on a dataset of human hands show the potential for rapidly learning to predict 3D pose for articulated structures other than the human body.

📄 PDF Abstract BibTeX arXiv:2304.02349

Code (0)

등록된 구현이 없습니다.

Tasks

3D Human Pose EstimationPose Estimation

Similar Papers 제목 키워드 기반

Self-Supervised 3D Human Pose Estimation with Multiple-View Geometry

2021-08-17 · Arij Bouazizi, Julian Wiederer, Ulrich Kressel, Vasileios Belagiannis

We present a self-supervised learning algorithm for 3D human pose estimation of a single person based on a multiple-view camera system and 2D body pose estimates for each view. To train our model, represented by a deep n…

3D Human Pose EstimationPose EstimationSelf-Supervised LearningWeakly-supervised 3D Human Pose Estimation+1

Self-Supervised 3D Human Pose Estimation via Part Guided Novel Image Synthesis

2020-04-09 · CVPR 2020 6 · Jogendra Nath Kundu, Siddharth Seth, Varun Jampani, Mugalodi Rakesh 외

Camera captured human pose is an outcome of several sources of variation. Performance of supervised 3D pose estimation approaches comes at the cost of dispensing with variations, such as shape and appearance, that may be…

3D Human Pose Estimation3D Pose EstimationDisentanglementImage Generation+4

Unsupervised 3D Pose Estimation with Geometric Self-Supervision

2019-04-09 · CVPR 2019 6 · Ching-Hang Chen, Ambrish Tyagi, Amit Agrawal, Dylan Drover 외

We present an unsupervised learning approach to recover 3D human pose from 2D skeletal joints extracted from a single image. Our method does not require any multi-view image data, 3D skeletons, correspondences between 2D…

3D Human Pose Estimation3D Pose EstimationPose Estimationvalid

Fast Adaptation for Human Pose Estimation via Meta-Optimization

2024-01-01 · CVPR 2024 1 · Shengxiang Hu, Huaijiang Sun, Bin Li, Dong Wei 외

Domain shift is a challenge for supervised human pose estimation where the source data and target data come from different distributions. This is why pose estimation methods generally perform worse on the test set th…

Auxiliary LearningImage InpaintingMeta-LearningPose Estimation+2

SVMAC: Unsupervised 3D Human Pose Estimation from a Single Image with Single-view-multi-angle Consistency

2021-06-10 · Yicheng Deng, Cheng Sun, Jiahui Zhu, Yongqi Sun

Recovering 3D human pose from 2D joints is still a challenging problem, especially without any 3D annotation, video information, or multi-view information. In this paper, we present an unsupervised GAN-based model consis…

3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationUnsupervised 3D Human Pose Estimation