Dynamic Support Information Mining for Category-Agnostic Pose Estimation
Category-agnostic pose estimation (CAPE) aims to predict the pose of a query image based on few support images with pose annotations. Existing methods achieve the localization of arbitrary keypoints through similarity matching between support keypoint features and query image features. However these methods primarily focus on mining information from the query images neglecting the fact that support samples with keypoint annotations contain rich category-specific fine-grained semantic information and prior structural information. In this paper we propose a Support-based Dynamic Perception Network (SDPNet) for the robust and accurate CAPE. On the one hand SDPNet models complex dependencies between support keypoints constructing category-specific prior structure to guide the interaction of query keypoints. On the other hand SDPNet extracts fine-grained semantic information from support samples dynamically modulating the refinement process of query. Our method outperforms existing methods on MP-100 dataset by a large margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Category-Agnostic Pose EstimationPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Intermediate Prototype Mining Transformer for Few-Shot Semantic Segmentation
Few-shot semantic segmentation aims to segment the target objects in query under the condition of a few annotated support images. Most previous works strive to mine more effective category information from the support to…
Few-Shot Semantic SegmentationSemantic SegmentationRecurrent Feature Mining and Keypoint Mixup Padding for Category-Agnostic Pose Estimation
Category-agnostic pose estimation aims to locate keypoints on query images according to a few annotated support images for arbitrary novel classes. Existing methods generally extract support features via heatmap pooling,…
Category-Agnostic Pose EstimationPose EstimationCapeNext: Rethinking and Refining Dynamic Support Information for Category-Agnostic Pose Estimation
Recent research in Category-Agnostic Pose Estimation (CAPE) has adopted fixed textual keypoint description as semantic prior for two-stage pose matching frameworks. While this paradigm enhances robustness and flexibility…
Category-Agnostic Pose EstimationReference-based Category Discovery: Unsupervised Object Detection with Category Awareness
Traditional one-shot detection methods have addressed the closed-set problem in object detection, but the high cost of data annotation remains a critical challenge. General unsupervised methods generate pseudo boxes with…
Object DetectionCapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models
Category-agnostic pose estimation (CAPE) has traditionally relied on support images with annotated keypoints, a process that is often cumbersome and may fail to fully capture the necessary correspondences across diverse …
2D Pose EstimationCategory-Agnostic Pose EstimationLanguage ModelingLanguage Modelling+4