Semi- and Weakly-supervised Human Pose Estimation
For human pose estimation in still images, this paper proposes three semi- and weakly-supervised learning schemes. While recent advances of convolutional neural networks improve human pose estimation using supervised training data, our focus is to explore the semi- and weakly-supervised schemes. Our proposed schemes initially learn conventional model(s) for pose estimation from a small amount of standard training images with human pose annotations. For the first semi-supervised learning scheme, this conventional pose model detects candidate poses in training images with no human annotation. From these candidate poses, only true-positives are selected by a classifier using a pose feature representing the configuration of all body parts. The accuracies of these candidate pose estimation and true-positive pose selection are improved by action labels provided to these images in our second and third learning schemes, which are semi- and weakly-supervised learning. While the first and second learning schemes select only poses that are similar to those in the supervised training data, the third scheme selects more true-positive poses that are significantly different from any supervised poses. This pose selection is achieved by pose clustering using outlier pose detection with Dirichlet process mixtures and the Bayes factor. The proposed schemes are validated with large-scale human pose datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringPose EstimationWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Weakly-Supervised Physically Unconstrained Gaze Estimation
A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environ…
Domain GeneralizationGaze EstimationWeakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild
One major challenge for monocular 3D human pose estimation in-the-wild is the acquisition of training data that contains unconstrained images annotated with accurate 3D poses. In this paper, we address this challenge by …
3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationWeakly-superavised 3D Human Pose Estimation+1Weakly-Supervised 3D Pose Estimation from a Single Image using Multi-View Consistency
We present a novel data-driven regularizer for weakly-supervised learning of 3D human pose estimation that eliminates the drift problem that affects existing approaches. We do this by moving the stereo reconstruction pro…
3D Human Pose Estimation3D Pose Estimation3D ReconstructionPose Estimation+1Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation
Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weakly-supervised methods require less supervision, by utilizing 2D poses or multi-view imagery withou…
3D geometry3D Human Pose EstimationDecoderPose Estimation+1MaskingDepth: Masked Consistency Regularization for Semi-supervised Monocular Depth Estimation
We propose MaskingDepth, a novel semi-supervised learning framework for monocular depth estimation to mitigate the reliance on large ground-truth depth quantities. MaskingDepth is designed to enforce consistency between …
Data AugmentationDepth EstimationDomain AdaptationImage Classification+4