Skeleton-based Action Recognition with Convolutional Neural Networks
Current state-of-the-art approaches to skeleton-based action recognition are mostly based on recurrent neural networks (RNN). In this paper, we propose a novel convolutional neural networks (CNN) based framework for both action classification and detection. Raw skeleton coordinates as well as skeleton motion are fed directly into CNN for label prediction. A novel skeleton transformer module is designed to rearrange and select important skeleton joints automatically. With a simple 7-layer network, we obtain 89.3% accuracy on validation set of the NTU RGB+D dataset. For action detection in untrimmed videos, we develop a window proposal network to extract temporal segment proposals, which are further classified within the same network. On the recent PKU-MMD dataset, we achieve 93.7% mAP, surpassing the baseline by a large margin.
Code (1)
Tasks
Action ClassificationAction DetectionAction RecognitionGeneral ClassificationSkeleton Based Action RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Predictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition
In skeleton-based action recognition, graph convolutional networks (GCNs), which model human body skeletons using graphical components such as nodes and connections, have achieved remarkable performance recently. However…
Action RecognitionSkeleton Based Action RecognitionGraph Edge Convolutional Neural Networks for Skeleton Based Action Recognition
This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action rec…
Action RecognitionPose EstimationSkeleton Based Action RecognitionTemporal Action LocalizationDynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition
Graph convolutional networks (GCNs) based methods have achieved advanced performance on skeleton-based action recognition task. However, the skeleton graph cannot fully represent the motion information contained in skele…
Action RecognitionSkeleton Based Action RecognitionReL-SAR: Representation Learning for Skeleton Action Recognition with Convolutional Transformers and BYOL
To extract robust and generalizable skeleton action recognition features, large amounts of well-curated data are typically required, which is a challenging task hindered by annotation and computation costs. Therefore, un…
Action RecognitionComputational EfficiencyRepresentation LearningA Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition
Action recognition with skeleton data is a challenging task in computer vision. Graph convolutional networks (GCNs), which directly model the human body skeletons as the graph structure, have achieved remarkable performa…
Action RecognitionSkeleton Based Action Recognition