Multi-Context Attention for Human Pose Estimation
In this paper, we propose to incorporate convolutional neural networks with a multi-context attention mechanism into an end-to-end framework for human pose estimation. We adopt stacked hourglass networks to generate attention maps from features at multiple resolutions with various semantics. The Conditional Random Field (CRF) is utilized to model the correlations among neighboring regions in the attention map. We further combine the holistic attention model, which focuses on the global consistency of the full human body, and the body part attention model, which focuses on the detailed description for different body parts. Hence our model has the ability to focus on different granularity from local salient regions to global semantic-consistent spaces. Additionally, we design novel Hourglass Residual Units (HRUs) to increase the receptive field of the network. These units are extensions of residual units with a side branch incorporating filters with larger receptive fields, hence features with various scales are learned and combined within the HRUs. The effectiveness of the proposed multi-context attention mechanism and the hourglass residual units is evaluated on two widely used human pose estimation benchmarks. Our approach outperforms all existing methods on both benchmarks over all the body parts.
Code (2)
Tasks
Pose EstimationSimilar Papers 제목 키워드 기반
MoEmo Vision Transformer: Integrating Cross-Attention and Movement Vectors in 3D Pose Estimation for HRI Emotion Detection
Emotion detection presents challenges to intelligent human-robot interaction (HRI). Foundational deep learning techniques used in emotion detection are limited by information-constrained datasets or models that lack the …
3D Pose EstimationPose EstimationFull-Resolution Encoder-Decoder Networks with Multi-Scale Feature Fusion for Human Pose Estimation
To achieve more accurate 2D human pose estimation, we extend the successful encoder-decoder network, simple baseline network (SBN), in three ways. To reduce the quantization errors caused by the large output stride size,…
2D Human Pose EstimationDecoderPose EstimationQuantizationEnd-to-End Speaker Height and age estimation using Attention Mechanism with LSTM-RNN
Automatic height and age estimation of speakers using acoustic features is widely used for the purpose of human-computer interaction, forensics, etc. In this work, we propose a novel approach of using attention mechanism…
Age EstimationMulti-Task LearningA Graph Attention Spatio-temporal Convolutional Network for 3D Human Pose Estimation in Video
Spatio-temporal information is key to resolve occlusion and depth ambiguity in 3D pose estimation. Previous methods have focused on either temporal contexts or local-to-global architectures that embed fixed-length spatio…
3D Human Pose Estimation3D Pose EstimationGraph AttentionPose Estimation+1Attention Mechanism Exploits Temporal Contexts: Real-Time 3D Human Pose Reconstruction
We propose a novel attention-based framework for 3D human pose estimation from a monocular video. Despite the general success of end-to-end deep learning paradigms, our approach is based on two key observations: (1) temp…
2D Pose Estimation3D Human Pose EstimationMonocular 3D Human Pose EstimationPose Estimation