Self-Supervised 3D Human Pose Estimation with Multiple-View Geometry
We present a self-supervised learning algorithm for 3D human pose estimation of a single person based on a multiple-view camera system and 2D body pose estimates for each view. To train our model, represented by a deep neural network, we propose a four-loss function learning algorithm, which does not require any 2D or 3D body pose ground-truth. The proposed loss functions make use of the multiple-view geometry to reconstruct 3D body pose estimates and impose body pose constraints across the camera views. Our approach utilizes all available camera views during training, while the inference is single-view. In our evaluations, we show promising performance on Human3.6M and HumanEva benchmarks, while we also present a generalization study on MPI-INF-3DHP dataset, as well as several ablation results. Overall, we outperform all self-supervised learning methods and reach comparable results to supervised and weakly-supervised learning approaches. Our code and models are publicly available
Code (1)
Tasks
3D Human Pose EstimationPose EstimationSelf-Supervised LearningWeakly-supervised 3D Human Pose EstimationWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Test-Time Personalization with a Transformer for Human Pose Estimation
We propose to personalize a human pose estimator given a set of test images of a person without using any manual annotations. While there is a significant advancement in human pose estimation, it is still very challengin…
Pose EstimationSelf-Supervised 3D Human Pose Estimation via Part Guided Novel Image Synthesis
Camera captured human pose is an outcome of several sources of variation. Performance of supervised 3D pose estimation approaches comes at the cost of dispensing with variations, such as shape and appearance, that may be…
3D Human Pose Estimation3D Pose EstimationDisentanglementImage Generation+4SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation
We present a new self-supervised approach, SelfPose3d, for estimating 3d poses of multiple persons from multiple camera views. Unlike current state-of-the-art fully-supervised methods, our approach does not require any 2…
3D Pose EstimationPose EstimationSelf-Supervised LearningPatch2Self: Denoising Diffusion MRI with Self-Supervised Learning
Diffusion-weighted magnetic resonance imaging (DWI) is the only non-invasive method for quantifying microstructure and reconstructing white-matter pathways in the living human brain. Fluctuations from multiple sources cr…
DenoisingDiffusion MRISelf-Supervised LearningPatch2Self: Denoising Diffusion MRI with Self-Supervised Learning
Diffusion-weighted magnetic resonance imaging (DWI) is the only noninvasive method for quantifying microstructure and reconstructing white-matter pathways in the living human brain. Fluctuations from multiple sources cre…
DenoisingDiffusion MRIMedical DiagnosisSelf-Supervised Learning