Heuristic Weakly Supervised 3D Human Pose Estimation
Monocular 3D human pose estimation from RGB images has attracted significant attention in recent years. However, recent models depend on supervised training with 3D pose ground truth data or known pose priors for their target domains. 3D pose data is typically collected with motion capture devices, severely limiting their applicability. In this paper, we present a heuristic weakly supervised 3D human pose (HW-HuP) solution to estimate 3D poses in when no ground truth 3D pose data is available. HW-HuP learns partial pose priors from 3D human pose datasets and uses easy-to-access observations from the target domain to estimate 3D human pose and shape in an optimization and regression cycle. We employ depth data for weak supervision during training, but not inference. We show that HW-HuP meaningfully improves upon state-of-the-art models in two practical settings where 3D pose data can hardly be obtained: human poses in bed, and infant poses in the wild. Furthermore, we show that HW-HuP retains comparable performance to cutting-edge models on public benchmarks, even when such models train on 3D pose data.
Code (2)
Tasks
3D Human Pose Estimation3D Pose EstimationMonocular 3D Human Pose EstimationPose EstimationWeakly-supervised 3D Human Pose EstimationSimilar Papers 제목 키워드 기반
Semi- and Weakly-supervised Human Pose Estimation
For human pose estimation in still images, this paper proposes three semi- and weakly-supervised learning schemes. While recent advances of convolutional neural networks improve human pose estimation using supervised tra…
ClusteringPose EstimationWeakly-supervised LearningWeakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Network
Although monocular 3D human pose estimation methods have made significant progress, it is far from being solved due to the inherent depth ambiguity. Instead, exploiting multi-view information is a practical way to achiev…
3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationWeakly-supervised 3D Human Pose Estimation+1Weakly-Supervised Physically Unconstrained Gaze Estimation
A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environ…
Domain GeneralizationGaze EstimationWeakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving
Accurate 3D human pose estimation (3D HPE) is crucial for enabling autonomous vehicles (AVs) to make informed decisions and respond proactively in critical road scenarios. Promising results of 3D HPE have been gained in …
3D Human Pose EstimationAutonomous DrivingAutonomous VehiclesPose Estimation+1Error Bounds of Projection Models in Weakly Supervised 3D Human Pose Estimation
The current state-of-the-art in monocular 3D human pose estimation is heavily influenced by weakly supervised methods. These allow 2D labels to be used to learn effective 3D human pose recovery either directly from image…
3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationPosition+1