Part-based Graph Convolutional Network for Action Recognition
Human actions comprise of joint motion of articulated body parts or `gestures'. Human skeleton is intuitively represented as a sparse graph with joints as nodes and natural connections between them as edges. Graph convolutional networks have been used to recognize actions from skeletal videos. We introduce a part-based graph convolutional network (PB-GCN) for this task, inspired by Deformable Part-based Models (DPMs). We divide the skeleton graph into four subgraphs with joints shared across them and learn a recognition model using a part-based graph convolutional network. We show that such a model improves performance of recognition, compared to a model using entire skeleton graph. Instead of using 3D joint coordinates as node features, we show that using relative coordinates and temporal displacements boosts performance. Our model achieves state-of-the-art performance on two challenging benchmark datasets NTURGB+D and HDM05, for skeletal action recognition.
Code (1)
Tasks
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Action Recognition via Pose-Based Graph Convolutional Networks with Intermediate Dense Supervision
Pose-based action recognition has drawn considerable attention recently. Existing methods exploit the joint positions to extract the body-part features from the activation map of the convolutional networks to assist huma…
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationDD-GCN: Directed Diffusion Graph Convolutional Network for Skeleton-based Human Action Recognition
Graph Convolutional Networks (GCNs) have been widely used in skeleton-based human action recognition. In GCN-based methods, the spatio-temporal graph is fundamental for capturing motion patterns. However, existing approa…
Action RecognitionTemporal Action LocalizationUnifying Graph Embedding Features with Graph Convolutional Networks for Skeleton-based Action Recognition
Combining skeleton structure with graph convolutional networks has achieved remarkable performance in human action recognition. Since current research focuses on designing basic graph for representing skeleton data, thes…
Action RecognitionGraph EmbeddingSkeleton Based Action RecognitionTemporal Action LocalizationLearning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognition
Learning graph convolutional networks (GCNs) is an emerging field which aims at generalizing convolutional operations to arbitrary non-regular domains. In particular, GCNs operating on spatial domains show superior perfo…
Action RecognitionSkeleton Based Action RecognitionSTEP CATFormer: Spatial-Temporal Effective Body-Part Cross Attention Transformer for Skeleton-based Action Recognition
Graph convolutional networks (GCNs) have been widely used and achieved remarkable results in skeleton-based action recognition. We think the key to skeleton-based action recognition is a skeleton hanging in frames, so we…
Action RecognitionSkeleton Based Action Recognition