Contextual Instance Decoupling for Robust Multi-Person Pose Estimation
Crowded scenes make it challenging to differentiate persons and locate their pose keypoints. This paper proposes the Contextual Instance Decoupling (CID), which presents a new pipeline for multi-person pose estimation. Instead of relying on person bounding boxes to spatially differentiate persons, CID decouples persons in an image into multiple instance-aware feature maps. Each of those feature maps is hence adopted to infer keypoints for a specific person. Compared with bounding box detection, CID is differentiable and robust to detection errors. Decoupling persons into different feature maps allows to isolate distractions from other persons, and explore context cues at scales larger than the bounding box size. Experiments show that CID outperforms previous multi-person pose estimation pipelines on crowded scenes pose estimation benchmarks in both accuracy and efficiency. For instance, it achieves 71.3% AP on CrowdPose, outperforming the recent single-stage DEKR by 5.6%, the bottom-up CenterAttention by 3.7%, and the top-down JC-SPPE by 5.3%. This advantage sustains on the commonly used COCO benchmark.
Code (1)
Tasks
Human Instance SegmentationMulti-Person Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
FediOS: Decoupling Orthogonal Subspaces for Personalization in Feature-skew Federated Learning
Personalized federated learning (pFL) enables collaborative training among multiple clients to enhance the capability of customized local models. In pFL, clients may have heterogeneous (also known as non-IID) data, which…
Federated LearningPersonalized Federated LearningA Multi-Level Contextual Model For Person Recognition in Photo Albums
In this work, we present a new framework for person recognition in photo albums that exploits contextual cues at multiple levels, spanning individual persons, individual photos, and photo groups. Through experiments, we…
Person RecognitionUnified Precision-Guaranteed Stopping Rules for Contextual Learning
Contextual learning seeks to learn a decision policy that maps an individual's characteristics to an action through data collection. In operations management, such data may come from various sources, and a central questi…
IVT: An End-to-End Instance-guided Video Transformer for 3D Pose Estimation
Video 3D human pose estimation aims to localize the 3D coordinates of human joints from videos. Recent transformer-based approaches focus on capturing the spatiotemporal information from sequential 2D poses, which cannot…
2D Pose Estimation3D Human Pose Estimation3D Multi-Person Pose Estimation3D Pose Estimation+1A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Name Entity Recognition
Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Most existing prototype-based sequence labeling models tend to memorize entity mentions which would be easil…
Contrastive Learningfew-shot-nerFew-shot NERnamed-entity-recognition+3