Unsupervised Domain Adaptation for Occlusion Resilient Human Pose Estimation
Occlusions are a significant challenge to human pose estimation algorithms, often resulting in inaccurate and anatomically implausible poses. Although current occlusion-robust human pose estimation algorithms exhibit impressive performance on existing datasets, their success is largely attributed to supervised training and the availability of additional information, such as multiple views or temporal continuity. Furthermore, these algorithms typically suffer from performance degradation under distribution shifts. While existing domain adaptive human pose estimation algorithms address this bottleneck, they tend to perform suboptimally when the target domain images are occluded, a common occurrence in real-life scenarios. To address these challenges, we propose OR-POSE: Unsupervised Domain Adaptation for Occlusion Resilient Human POSE Estimation. OR-POSE is an innovative unsupervised domain adaptation algorithm which effectively mitigates domain shifts and overcomes occlusion challenges by employing the mean teacher framework for iterative pseudo-label refinement. Additionally, OR-POSE reinforces realistic pose prediction by leveraging a learned human pose prior which incorporates the anatomical constraints of humans in the adaptation process. Lastly, OR-POSE avoids overfitting to inaccurate pseudo labels generated from heavily occluded images by employing a novel visibility-based curriculum learning approach. This enables the model to gradually transition from training samples with relatively less occlusion to more challenging, heavily occluded samples. Extensive experiments show that OR-POSE outperforms existing analogous state-of-the-art algorithms by $\sim$ 7% on challenging occluded human pose estimation datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationPose EstimationPose PredictionPseudo LabelUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
An End-to-End Framework for Unsupervised Pose Estimation of Occluded Pedestrians
Pose estimation in the wild is a challenging problem, particularly in situations of (i) occlusions of varying degrees and (ii) crowded outdoor scenes. Most of the existing studies of pose estimation did not report the pe…
Domain AdaptationInstance SegmentationPedestrian DetectionPose Estimation+1Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation
The advances in monocular 3D human pose estimation are dominated by supervised techniques that require large-scale 2D/3D pose annotations. Such methods often behave erratically in the absence of any provision to discard …
3D Human Pose EstimationDomain AdaptationMonocular 3D Human Pose EstimationPose Estimation+3Prototype and Instance Contrastive Learning for Unsupervised Domain Adaptation in Speaker Verification
Speaker verification system trained on one domain usually suffers performance degradation when applied to another domain. To address this challenge, researchers commonly use feature distribution matching-based methods in…
Contrastive LearningDomain AdaptationSpeaker VerificationUnsupervised Domain AdaptationPC-Adapter: Topology-Aware Adapter for Efficient Domain Adaption on Point Clouds with Rectified Pseudo-label
Understanding point clouds captured from the real-world is challenging due to shifts in data distribution caused by varying object scales, sensor angles, and self-occlusion. Prior works have addressed this issue by combi…
Domain AdaptationPseudo LabelSelf-Supervised LearningLabeling Where Adapting Fails: Cross-Domain Semantic Segmentation with Point Supervision via Active Selection
Training models dedicated to semantic segmentation requires a large amount of pixel-wise annotated data. Due to their costly nature, these annotations might not be available for the task at hand. To alleviate this proble…
Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation