paper-with-me

Papers

DeforHMR: Vision Transformer with Deformable Cross-Attention for 3D Human Mesh Recovery

2024-11-18 · Jaewoo Heo, George Hu, Zeyu Wang, Serena Yeung-Levy

Human Mesh Recovery (HMR) is an important yet challenging problem with applications across various domains including motion capture, augmented reality, and biomechanics. Accurately predicting human pose parameters from a single image remains a challenging 3D computer vision task. In this work, we introduce DeforHMR, a novel regression-based monocular HMR framework designed to enhance the prediction of human pose parameters using deformable attention transformers. DeforHMR leverages a novel query-agnostic deformable cross-attention mechanism within the transformer decoder to effectively regress the visual features extracted from a frozen pretrained vision transformer (ViT) encoder. The proposed deformable cross-attention mechanism allows the model to attend to relevant spatial features more flexibly and in a data-dependent manner. Equipped with a transformer decoder capable of spatially-nuanced attention, DeforHMR achieves state-of-the-art performance for single-frame regression-based methods on the widely used 3D HMR benchmarks 3DPW and RICH. By pushing the boundary on the field of 3D human mesh recovery through deformable attention, we introduce an new, effective paradigm for decoding local spatial information from large pretrained vision encoders in computer vision.

📄 PDF Abstract BibTeX arXiv:2411.11214

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderHuman Mesh Recoveryregression

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

Attention Deficit is Ordered! Fooling Deformable Vision Transformers with Collaborative Adversarial Patches

2023-11-21 · Quazi Mishkatul Alam, Bilel Tarchoun, Ihsen Alouani, Nael Abu-Ghazaleh

The latest generation of transformer-based vision models has proven to be superior to Convolutional Neural Network (CNN)-based models across several vision tasks, largely attributed to their remarkable prowess in relatio…

object-detectionObject Detection

Cross-Modal Learning with 3D Deformable Attention for Action Recognition

2022-12-12 · ICCV 2023 1 · Sangwon Kim, Dasom Ahn, Byoung Chul Ko

An important challenge in vision-based action recognition is the embedding of spatiotemporal features with two or more heterogeneous modalities into a single feature. In this study, we propose a new 3D deformable transfo…

Action Recognition

DeBiFormer: Vision Transformer with Deformable Agent Bi-level Routing Attention

2024-10-11 · Nguyen Huu Bao Long, Chenyu Zhang, Yuzhi Shi, Tsubasa Hirakawa 외

Vision Transformers with various attention modules have demonstrated superior performance on vision tasks. While using sparsity-adaptive attention, such as in DAT, has yielded strong results in image classification, the …

image-classificationImage Classificationobject-detectionObject Detection+1

DAT++: Spatially Dynamic Vision Transformer with Deformable Attention

2023-09-04 · Zhuofan Xia, Xuran Pan, Shiji Song, Li Erran Li 외

Transformers have shown superior performance on various vision tasks. Their large receptive field endows Transformer models with higher representation power than their CNN counterparts. Nevertheless, simply enlarging the…

Image ClassificationInstance SegmentationObject DetectionSemantic Segmentation

Vision Transformer with Deformable Attention

2022-01-03 · CVPR 2022 1 · Zhuofan Xia, Xuran Pan, Shiji Song, Li Erran Li 외

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Ne…

image-classificationImage ClassificationObject DetectionSemantic Segmentation