Global Relation Modeling and Refinement for Bottom-Up Human Pose Estimation
In this paper, we concern on the bottom-up paradigm in multi-person pose estimation (MPPE). Most previous bottom-up methods try to consider the relation of instances to identify different body parts during the post processing, while ignoring to model the relation among instances or environment in the feature learning process. In addition, most existing works adopt the operations of upsampling and downsampling. During the sampling process, there will be a problem of misalignment with the source features, resulting in deviations in the keypoint features learned by the model. To overcome the above limitations, we propose a convolutional neural network for bottom-up human pose estimation. It invovles two basic modules: (i) Global Relation Modeling (GRM) module globally learns relation (e.g., environment context, instance interactive information) among region of image by fusing multiple stages features in the feature learning process. It combines with the spatial-channel attention mechanism, which focuses on achieving adaptability in spatial and channel dimensions. (ii) Multi-branch Feature Align (MFA) module aggregates features from multiple branches to align fused feature and obtain refined local keypoint representation. Our model has the ability to focus on different granularity from local to global regions, which significantly boosts the performance of the multi-person pose estimation. Our results on the COCO and CrowdPose datasets demonstrate that it is an efficient framework for multi-person pose estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Person Pose EstimationPose EstimationRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detection
Human Object Interaction (HOI) detection is a challenging task that requires to distinguish the interaction between a human-object pair. Attention based relation parsing is a popular and effective strategy utilized in HO…
DecoderHuman-Object Interaction DetectionRelationRefinement Module based on Parse Graph of Feature Map for Human Pose Estimation
The parse graph play a crucial role in enhancing the performance of human pose estimation (HPE). Its key advantage lies in its hierarchical structure, like a tree structure, and context relations among nodes, which enabl…
Keypoint DetectionPose EstimationHigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimation
Bottom-up human pose estimation methods have difficulties in predicting the correct pose for small persons due to challenges in scale variation. In this paper, we present HigherHRNet: a novel bottom-up human pose estimat…
2D Human Pose EstimationMulti-Person Pose EstimationPose EstimationPose Prediction+1PoSeg: Pose-Aware Refinement Network for Human Instance Segmentation
Human instance segmentation is a core problem for human-centric scene understanding and segmenting human instances poses a unique challenge to vision systems due to large intra-class variations in both appearance and sha…
Human Instance SegmentationInstance SegmentationPose EstimationScene Understanding+2AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regression
Multi-person pose estimation generally follows top-down and bottom-up paradigms. Both of them use an extra stage ($\boldsymbol{e.g.,}$ human detection in top-down paradigm or grouping process in bottom-up paradigm) to bu…
3D Multi-Person Pose EstimationHuman DetectionMulti-Person Pose EstimationPose Estimation+1