paper-with-me

홈 › Papers

GraFormer: Graph-Oriented Transformer for 3D Pose Estimation

2022-01-01 · CVPR 2022 1 · Weixi Zhao, Weiqiang Wang, Yunjie Tian

In 2D-to-3D pose estimation, it is important to exploit the spatial constraints of 2D joints, but it is not yet well modeled. To better model the relation of joints for 3D pose estimation, we propose an effective but simple network, called GraFormer, where a novel transformer architecture is designed via embedding graph convolution layers after multi-head attention block. The proposed GraFormer is built by repeatedly stacking the GraAttention block and the ChebGConv block. The proposed GraAttention block is a new transformer block designed for processing graph-structured data, which is able to learn better features through capturing global information from all the nodes as well as the explicit adjacency structure of nodes. To model the implicit high-order connection relations among non-neighboring nodes, the ChebGConv block is introduced to exchange information between non-neighboring nodes and attain a larger receptive field. We have empirically shown the superiority of GraFormer through extensive experiments on popular public datasets. Specifically, GraFormer outperforms the state-of-the-art GraghSH on the Human3.6M dataset yet only contains 18% parameters of it

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Pose EstimationPose Estimation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

GraFormer: Graph Convolution Transformer for 3D Pose Estimation

2021-09-17 · Weixi Zhao, Yunjie Tian, Qixiang Ye, Jianbin Jiao 외

Exploiting relations among 2D joints plays a crucial role yet remains semi-developed in 2D-to-3D pose estimation. To alleviate this issue, we propose GraFormer, a novel transformer architecture combined with graph convol…

3D Pose EstimationImplicit RelationsPose Estimation

Modeling Graph Structure via Relative Position for Text Generation from Knowledge Graphs

2020-06-16 · NAACL (TextGraphs) 2021 6 · Martin Schmitt, Leonardo F. R. Ribeiro, Philipp Dufter, Iryna Gurevych 외

We present Graformer, a novel Transformer-based encoder-decoder architecture for graph-to-text generation. With our novel graph self-attention, the encoding of a node relies on all nodes in the input graph - not only dir…

Data-to-Text GenerationDecoderKG-to-Text GenerationKnowledge Graphs+2

THOR-Net: End-to-end Graformer-based Realistic Two Hands and Object Reconstruction with Self-supervision

2022-10-25 · Ahmed Tawfik Aboukhadra, Jameel Malik, Ahmed Elhayek, Nadia Robertini 외

Realistic reconstruction of two hands interacting with objects is a new and challenging problem that is essential for building personalized Virtual and Augmented Reality environments. Graph Convolutional networks (GCNs) …

Hand Pose EstimationObject ReconstructionPose Estimation

ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction from a Single Depth Map

2023-10-18 · Ahmed Tawfik Aboukhadra, Jameel Malik, Nadia Robertini, Ahmed Elhayek 외

3D reconstruction of hand-object manipulations is important for emulating human actions. Most methods dealing with challenging object manipulation scenarios, focus on hands reconstruction in isolation, ignoring physical …

3D ReconstructionObjectObject ReconstructionPose Estimation

K-Order Graph-oriented Transformer with GraAttention for 3D Pose and Shape Estimation

2022-08-24 · Weixi Zhao, Weiqiang Wang

We propose a novel attention-based 2D-to-3D pose estimation network for graph-structured data, named KOG-Transformer, and a 3D pose-to-shape estimation network for hand data, named GASE-Net. Previous 3D pose estimation m…

3D Pose EstimationPose Estimation