Expressive Keypoints for Skeleton-based Action Recognition via Skeleton Transformation
In the realm of skeleton-based action recognition, the traditional methods which rely on coarse body keypoints fall short of capturing subtle human actions. In this work, we propose Expressive Keypoints that incorporates hand and foot details to form a fine-grained skeletal representation, improving the discriminative ability for existing models in discerning intricate actions. To efficiently model Expressive Keypoints, the Skeleton Transformation strategy is presented to gradually downsample the keypoints and prioritize prominent joints by allocating the importance weights. Additionally, a plug-and-play Instance Pooling module is exploited to extend our approach to multi-person scenarios without surging computation costs. Extensive experimental results over seven datasets present the superiority of our method compared to the state-of-the-art for skeleton-based human action recognition. Code is available at https://github.com/YijieYang23/SkeleT-GCN.
Code (1)
Tasks
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
PREDICT & CLUSTER: Unsupervised Skeleton Based Action Recognition
We propose a novel system for unsupervised skeleton-based action recognition. Given inputs of body keypoints sequences obtained during various movements, our system associates the sequences with actions. Our system is ba…
Action RecognitionDecoderSelf-Supervised Human Action RecognitionSelf-supervised Skeleton-based Action Recognition+2Action Segmentation Using 2D Skeleton Heatmaps and Multi-Modality Fusion
This paper presents a 2D skeleton-based action segmentation method with applications in fine-grained human activity recognition. In contrast with state-of-the-art methods which directly take sequences of 3D skeleton coor…
Action SegmentationActivity RecognitionHuman Activity RecognitionSegmentation+1Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Dynamics of human body skeletons convey significant information for human action recognition. Conventional approaches for modeling skeletons usually rely on hand-crafted parts or traversal rules, thus resulting in limite…
3D Human Pose EstimationAction RecognitionMultimodal Activity RecognitionSkeleton Based Action Recognition+1Sign Language Recognition via Skeleton-Aware Multi-Model Ensemble
Sign language is commonly used by deaf or mute people to communicate but requires extensive effort to master. It is usually performed with the fast yet delicate movement of hand gestures, body posture, and even facial ex…
Action RecognitionSign Language RecognitionSkeleton Based Action RecognitionSkeFi: Cross-Modal Knowledge Transfer for Wireless Skeleton-Based Action Recognition
Skeleton-based action recognition leverages human pose keypoints to categorize human actions, which shows superior generalization and interoperability compared to regular end-to-end action recognition. Existing solutions…
Action Recognition