Semi-supervised Keypoint Localization
Knowledge about the locations of keypoints of an object in an image can assist in fine-grained classification and identification tasks, particularly for the case of objects that exhibit large variations in poses that greatly influence their visual appearance, such as wild animals. However, supervised training of a keypoint detection network requires annotating a large image dataset for each animal species, which is a labor-intensive task. To reduce the need for labeled data, we propose to learn simultaneously keypoint heatmaps and pose invariant keypoint representations in a semi-supervised manner using a small set of labeled images along with a larger set of unlabeled images. Keypoint representations are learnt with a semantic keypoint consistency constraint that forces the keypoint detection network to learn similar features for the same keypoint across the dataset. Pose invariance is achieved by making keypoint representations for the image and its augmented copies closer together in feature space. Our semi-supervised approach significantly outperforms previous methods on several benchmarks for human and animal body landmark localization.
Code (0)
등록된 구현이 없습니다.
Tasks
Keypoint DetectionSimilar Papers 제목 키워드 기반
Pseudo-Labeled Auto-Curriculum Learning for Semi-Supervised Keypoint Localization
Localizing keypoints of an object is a basic visual problem. However, supervised learning of a keypoint localization network often requires a large amount of data, which is expensive and time-consuming to obtain. To reme…
Learning to Produce Semi-dense Correspondences for Visual Localization
This study addresses the challenge of performing visual localization in demanding conditions such as night-time scenarios, adverse weather, and seasonal changes. While many prior studies have focused on improving image-m…
Camera Pose EstimationPose EstimationVisual LocalizationFew-shot Geometry-Aware Keypoint Localization
Supervised keypoint localization methods rely on large manually labeled image datasets, where objects can deform, articulate, or occlude. However, creating such large keypoint labels is time-consuming and costly, and is …
3D geometryObject LocalizationSemi-supervised 2D Human Pose Estimation via Adaptive Keypoint Masking
Human pose estimation is a fundamental and challenging task in computer vision. Larger-scale and more accurate keypoint annotations, while helpful for improving the accuracy of supervised pose estimation, are often expen…
2D Human Pose EstimationData AugmentationPose EstimationSemi-Supervised 2D Human Pose Estimation Driven by Position Inconsistency Pseudo Label Correction Module
In this paper, we delve into semi-supervised 2D human pose estimation. The previous method ignored two problems: (i) When conducting interactive training between large model and lightweight model, the pseudo label of lig…
2D Human Pose EstimationPose EstimationPositionPseudo Label