How Robust is 3D Human Pose Estimation to Occlusion?
Occlusion is commonplace in realistic human-robot shared environments, yet its effects are not considered in standard 3D human pose estimation benchmarks. This leaves the question open: how robust are state-of-the-art 3D pose estimation methods against partial occlusions? We study several types of synthetic occlusions over the Human3.6M dataset and find a method with state-of-the-art benchmark performance to be sensitive even to low amounts of occlusion. Addressing this issue is key to progress in applications such as collaborative and service robotics. We take a first step in this direction by improving occlusion-robustness through training data augmentation with synthetic occlusions. This also turns out to be an effective regularizer that is beneficial even for non-occluded test cases.
Code (2)
Tasks
3D Human Pose Estimation3D Pose EstimationData AugmentationPose EstimationSimilar Papers 제목 키워드 기반
Beyond Tree Structure Models: A New Occlusion Aware Graphical Model for Human Pose Estimation
Occlusion is a main challenge for human pose estimation, which is largely ignored in popular tree structure models. The tree structure model is simple and convenient for exact inference, but short in modeling the occlusi…
2D Human Pose EstimationPose EstimationTilting at windmills: Data augmentation for deep pose estimation does not help with occlusions
Occlusion degrades the performance of human pose estimation. In this paper, we introduce targeted keypoint and body part occlusion attacks. The effects of the attacks are systematically analyzed on the best performing me…
Data AugmentationPose EstimationLASOR: Learning Accurate 3D Human Pose and Shape Via Synthetic Occlusion-Aware Data and Neural Mesh Rendering
A key challenge in the task of human pose and shape estimation is occlusion, including self-occlusions, object-human occlusions, and inter-person occlusions. The lack of diverse and accurate pose and shape training data …
3D Human Pose Estimation3D Human Shape EstimationPose EstimationMulti-view Pose Fusion for Occlusion-Aware 3D Human Pose Estimation
Robust 3D human pose estimation is crucial to ensure safe and effective human-robot collaboration. Accurate human perception,however, is particularly challenging in these scenarios due to strong occlusions and limited ca…
3D Human Pose Estimation3D Pose EstimationPose EstimationExplicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation
Occlusion poses a great threat to monocular multi-person 3D human pose estimation due to large variability in terms of the shape, appearance, and position of occluders. While existing methods try to handle occlusion with…
3D Human Pose Estimation3D Multi-Person Pose Estimation (absolute)3D Multi-Person Pose Estimation (root-relative)Data Augmentation+1