paper-with-me

Papers

Multi-hop graph transformer network for 3D human pose estimation

2024-05-05 · Zaedul Islam, A. Ben Hamza

Accurate 3D human pose estimation is a challenging task due to occlusion and depth ambiguity. In this paper, we introduce a multi-hop graph transformer network designed for 2D-to-3D human pose estimation in videos by leveraging the strengths of multi-head self-attention and multi-hop graph convolutional networks with disentangled neighborhoods to capture spatio-temporal dependencies and handle long-range interactions. The proposed network architecture consists of a graph attention block composed of stacked layers of multi-head self-attention and graph convolution with learnable adjacency matrix, and a multi-hop graph convolutional block comprised of multi-hop convolutional and dilated convolutional layers. The combination of multi-head self-attention and multi-hop graph convolutional layers enables the model to capture both local and global dependencies, while the integration of dilated convolutional layers enhances the model's ability to handle spatial details required for accurate localization of the human body joints. Extensive experiments demonstrate the effectiveness and generalization ability of our model, achieving competitive performance on benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2405.03055

Code (0)

등록된 구현이 없습니다.

Tasks

3D Human Pose EstimationGraph AttentionPose Estimation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LapEigen 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

A Modular Multi-stage Lightweight Graph Transformer Network for Human Pose and Shape Estimation from 2D Human Pose

2023-01-31 · Ayman Ali, Ekkasit Pinyoanuntapong, Pu Wang, Mohsen Dorodchi

In this research, we address the challenge faced by existing deep learning-based human mesh reconstruction methods in balancing accuracy and computational efficiency. These methods typically prioritize accuracy, resultin…

Computational Efficiency

K-Order Graph-oriented Transformer with GraAttention for 3D Pose and Shape Estimation

2022-08-24 · Weixi Zhao, Weiqiang Wang

We propose a novel attention-based 2D-to-3D pose estimation network for graph-structured data, named KOG-Transformer, and a 3D pose-to-shape estimation network for hand data, named GASE-Net. Previous 3D pose estimation m…

3D Pose EstimationPose Estimation

3D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer

2025-05-02 · Kamel Aouaidjia, Aofan Li, WenHao Zhang, Chongsheng Zhang

Nowadays, Transformers and Graph Convolutional Networks (GCNs) are the prevailing techniques for 3D human pose estimation. However, Transformer-based methods either ignore the spatial neighborhood relationships between t…

3D Human Pose EstimationPose Estimation

Pose Uncertainty Aware Movement Synchrony Estimation via Spatial-Temporal Graph Transformer

2022-08-01 · Jicheng Li, Anjana Bhat, Roghayeh Barmaki

Movement synchrony reflects the coordination of body movements between interacting dyads. The estimation of movement synchrony has been automated by powerful deep learning models such as transformer networks. However, in…

Activity RecognitionContrastive LearningHuman Activity RecognitionKnowledge Distillation+1

SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation

2024-04-23 · Xiangyu Xu, Lijuan Liu, Shuicheng Yan

Existing Transformers for monocular 3D human shape and pose estimation typically have a quadratic computation and memory complexity with respect to the feature length, which hinders the exploitation of fine-grained infor…

3D Human Pose EstimationPose Estimation