Multi-hop graph transformer network for 3D human pose estimation
Accurate 3D human pose estimation is a challenging task due to occlusion and depth ambiguity. In this paper, we introduce a multi-hop graph transformer network designed for 2D-to-3D human pose estimation in videos by leveraging the strengths of multi-head self-attention and multi-hop graph convolutional networks with disentangled neighborhoods to capture spatio-temporal dependencies and handle long-range interactions. The proposed network architecture consists of a graph attention block composed of stacked layers of multi-head self-attention and graph convolution with learnable adjacency matrix, and a multi-hop graph convolutional block comprised of multi-hop convolutional and dilated convolutional layers. The combination of multi-head self-attention and multi-hop graph convolutional layers enables the model to capture both local and global dependencies, while the integration of dilated convolutional layers enhances the model's ability to handle spatial details required for accurate localization of the human body joints. Extensive experiments demonstrate the effectiveness and generalization ability of our model, achieving competitive performance on benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose EstimationGraph AttentionPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Modular Multi-stage Lightweight Graph Transformer Network for Human Pose and Shape Estimation from 2D Human Pose
In this research, we address the challenge faced by existing deep learning-based human mesh reconstruction methods in balancing accuracy and computational efficiency. These methods typically prioritize accuracy, resultin…
Computational EfficiencyK-Order Graph-oriented Transformer with GraAttention for 3D Pose and Shape Estimation
We propose a novel attention-based 2D-to-3D pose estimation network for graph-structured data, named KOG-Transformer, and a 3D pose-to-shape estimation network for hand data, named GASE-Net. Previous 3D pose estimation m…
3D Pose EstimationPose Estimation3D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer
Nowadays, Transformers and Graph Convolutional Networks (GCNs) are the prevailing techniques for 3D human pose estimation. However, Transformer-based methods either ignore the spatial neighborhood relationships between t…
3D Human Pose EstimationPose EstimationPose Uncertainty Aware Movement Synchrony Estimation via Spatial-Temporal Graph Transformer
Movement synchrony reflects the coordination of body movements between interacting dyads. The estimation of movement synchrony has been automated by powerful deep learning models such as transformer networks. However, in…
Activity RecognitionContrastive LearningHuman Activity RecognitionKnowledge Distillation+1SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation
Existing Transformers for monocular 3D human shape and pose estimation typically have a quadratic computation and memory complexity with respect to the feature length, which hinders the exploitation of fine-grained infor…
3D Human Pose EstimationPose Estimation