Skeleton-Based Action Recognition With Shift Graph Convolutional Network
Action recognition with skeleton data is attracting more attention in computer vision. Recently, graph convolutional networks (GCNs), which model the human body skeletons as spatiotemporal graphs, have obtained remarkable performance. However, the computational complexity of GCN-based methods are pretty heavy, typically over 15 GFLOPs for one action sample. Recent works even reach about 100 GFLOPs. Another shortcoming is that the receptive fields of both spatial graph and temporal graph are inflexible. Although some works enhance the expressiveness of spatial graph by introducing incremental adaptive modules, their performance is still limited by regular GCN structures. In this paper, we propose a novel shift graph convolutional network (Shift-GCN) to overcome both shortcomings. Instead of using heavy regular graph convolutions, our Shift-GCN is composed of novel shift graph operations and lightweight point-wise convolutions, where the shift graph operations provide flexible receptive fields for both spatial graph and temporal graph. On three datasets for skeleton-based action recognition, the proposed Shift-GCN notably exceeds the state-of-the-art methods with more than 10 times less computational complexity.
Code (1)
Tasks
Action RecognitionSkeleton Based Action RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Graph Edge Convolutional Neural Networks for Skeleton Based Action Recognition
This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action rec…
Action RecognitionPose EstimationSkeleton Based Action RecognitionTemporal Action LocalizationA Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition
Action recognition with skeleton data is a challenging task in computer vision. Graph convolutional networks (GCNs), which directly model the human body skeletons as the graph structure, have achieved remarkable performa…
Action RecognitionSkeleton Based Action RecognitionDynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition
Graph convolutional networks (GCNs) based methods have achieved advanced performance on skeleton-based action recognition task. However, the skeleton graph cannot fully represent the motion information contained in skele…
Action RecognitionSkeleton Based Action RecognitionPredictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition
In skeleton-based action recognition, graph convolutional networks (GCNs), which model human body skeletons using graphical components such as nodes and connections, have achieved remarkable performance recently. However…
Action RecognitionSkeleton Based Action RecognitionUnifying Graph Embedding Features with Graph Convolutional Networks for Skeleton-based Action Recognition
Combining skeleton structure with graph convolutional networks has achieved remarkable performance in human action recognition. Since current research focuses on designing basic graph for representing skeleton data, thes…
Action RecognitionGraph EmbeddingSkeleton Based Action RecognitionTemporal Action Localization