PCIE_EgoHandPose Solution for EgoExo4D Hand Pose Challenge

2024-06-18 · Feng Chen, Ling Ding, Kanokphan Lertniphonphan, Jian Li, Kaer Huang, Zhepeng Wang

This report presents our team's 'PCIE_EgoHandPose' solution for the EgoExo4D Hand Pose Challenge at CVPR2024. The main goal of the challenge is to accurately estimate hand poses, which involve 21 3D joints, using an RGB egocentric video image provided for the task. This task is particularly challenging due to the subtle movements and occlusions. To handle the complexity of the task, we propose the Hand Pose Vision Transformer (HP-ViT). The HP-ViT comprises a ViT backbone and transformer head to estimate joint positions in 3D, utilizing MPJPE and RLE loss function. Our approach achieved the 1st position in the Hand Pose challenge with 25.51 MPJPE and 8.49 PA-MPJPE. Code is available at https://github.com/KanokphanL/PCIE_EgoHandPose

📄 PDF Abstract BibTeX arXiv:2406.12219

Code (1)

kanokphanl/pcie_egohandpose 공식 구현 pytorch

Tasks

Position

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Adam 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

PCIE_Pose Solution for EgoExo4D Pose and Proficiency Estimation Challenge

2025-05-30 · Feng Chen, Kanokphan Lertniphonphan, Qiancheng Yan, Xiaohui Fan 외

This report introduces our team's (PCIE_EgoPose) solutions for the EgoExo4D Pose and Proficiency Estimation Challenges at CVPR2025. Focused on the intricate task of estimating 21 3D hand joints from RGB egocentric videos…

Pose Estimation

EgoExo-Gen: Ego-centric Video Prediction by Watching Exo-centric Videos

2025-04-16 · Jilan Xu, Yifei HUANG, Baoqi Pei, Junlin Hou 외

Generating videos in the first-person perspective has broad application prospects in the field of augmented reality and embodied intelligence. In this work, we explore the cross-view video prediction task, where given an…

Prediction Video Prediction

PCIE_Interaction Solution for Ego4D Social Interaction Challenge

2025-05-30 · Kanokphan Lertniphonphan, Feng Chen, Junda Xu, Fengbu Lan 외

This report presents our team's PCIE_Interaction solution for the Ego4D Social Interaction Challenge at CVPR 2025, addressing both Looking At Me (LAM) and Talking To Me (TTM) tasks. The challenge requires accurate detect…

EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understanding

2025-05-30 · Ege Özsoy, Arda Mamur, Felix Tristram, Chantal Pellegrini 외

Operating rooms (ORs) demand precise coordination among surgeons, nurses, and equipment in a fast-paced, occlusion-heavy environment, necessitating advanced perception models to enhance safety and efficiency. Existing da…

Action Recognition Graph Generation Scene Graph Generation

LayerScope: Predictive Cross-Layer Scheduling for Efficient Multi-Batch MoE Inference on Legacy Servers

2025-09-28 · Enda Yu, Dezun Dong, Zhaoning Zhang, Zhe Bai 외 arxiv

Mixture-of-Experts (MoE) models face memory and PCIe latency bottlenecks when deployed on commodity hardware. Offloading expert weights to CPU memory results in PCIe transfer latency that exceeds GPU computation by sever…