AMPose: Alternately Mixed Global-Local Attention Model for 3D Human Pose Estimation

2022-10-09 · Hongxin Lin, Yunwei Chiu, PeiYuan Wu

The graph convolutional networks (GCNs) have been applied to model the physically connected and non-local relations among human joints for 3D human pose estimation (HPE). In addition, the purely Transformer-based models recently show promising results in video-based 3D HPE. However, the single-frame method still needs to model the physically connected relations among joints because the feature representations transformed only by global relations via the Transformer neglect information on the human skeleton. To deal with this problem, we propose a novel method in which the Transformer encoder and GCN blocks are alternately stacked, namely AMPose, to combine the global and physically connected relations among joints towards HPE. In the AMPose, the Transformer encoder is applied to connect each joint with all the other joints, while GCNs are applied to capture information on physically connected relations. The effectiveness of our proposed method is evaluated on the Human3.6M dataset. Our model also shows better generalization ability by testing on the MPI-INF-3DHP dataset. Code can be retrieved at https://github.com/erikervalid/AMPose.

📄 PDF Abstract BibTeX arXiv:2210.04216

Code (0)

등록된 구현이 없습니다.

Tasks

3D Human Pose Estimation Pose Estimation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Residual Connection 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Global Convergence of Federated Learning for Mixed Regression

2022-06-15 · Lili Su, Jiaming Xu, Pengkun Yang

This paper studies the problem of model training under Federated Learning when clients exhibit cluster structure. We contextualize this problem in mixed regression, where each client has limited local data generated from…

Federated Learning regression

DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation

2025-11-12 · Jerrin Bright, Yuhao Chen, John S. Zelek arxiv

Accurate 3D human pose estimation remains a critical yet unresolved challenge, requiring both temporal coherence across frames and fine-grained modeling of joint relationships. However, most existing methods rely solely …

3D Human Pose Estimation 3D Pose Estimation

DreamPose: Fashion Video Synthesis with Stable Diffusion

2023-01-01 · ICCV 2023 1 · Johanna Karras, Aleksander Holynski, Ting-Chun Wang, Ira Kemelmacher-Shlizerman

We present DreamPose, a diffusion-based method for generating animated fashion videos from still images. Given an image and a sequence of human body poses, our method synthesizes a video containing both human and fab…

LiCamPose: Combining Multi-View LiDAR and RGB Cameras for Robust Single-frame 3D Human Pose Estimation

2023-12-11 · Zhiyu Pan, Zhicheng Zhong, Wenxuan Guo, Yifan Chen 외

Several methods have been proposed to estimate 3D human pose from multi-view images, achieving satisfactory performance on public datasets collected under relatively simple conditions. However, there are limited approach…

3D Human Pose Estimation Domain Adaptation Pose Estimation Unsupervised Domain Adaptation

Mixed Attention Network for Cross-domain Sequential Recommendation

2023-11-14 · GuanYu Lin, Chen Gao, Yu Zheng, Jianxin Chang 외

In modern recommender systems, sequential recommendation leverages chronological user behaviors to make effective next-item suggestions, which suffers from data sparsity issues, especially for new users. One promising li…

Recommendation Systems Sequential Recommendation