paper-with-me

홈 › Papers

High-Performance Inference Graph Convolutional Networks for Skeleton-Based Action Recognition

2023-05-30 · Junyi Wang, Ziao Li, Bangli Liu, Haibin Cai, Mohamad Saada, Qinggang Meng

Recently, the significant achievements have been made in skeleton-based human action recognition with the emergence of graph convolutional networks (GCNs). However, the state-of-the-art (SOTA) models used for this task focus on constructing more complex higher-order connections between joint nodes to describe skeleton information, which leads to complex inference processes and high computational costs. To address the slow inference speed caused by overly complex model structures, we introduce re-parameterization and over-parameterization techniques to GCNs and propose two novel high-performance inference GCNs, namely HPI-GCN-RP and HPI-GCN-OP. After the completion of model training, model parameters are fixed. HPI-GCN-RP adopts re-parameterization technique to transform high-performance training model into fast inference model through linear transformations, which achieves a higher inference speed with competitive model performance. HPI-GCN-OP further utilizes over-parameterization technique to achieve higher performance improvement by introducing additional inference parameters, albeit with slightly decreased inference speed. The experimental results on the two skeleton-based action recognition datasets demonstrate the effectiveness of our approach. Our HPI-GCN-OP achieves performance comparable to the current SOTA models, with inference speeds five times faster. Specifically, our HPI-GCN-OP achieves an accuracy of 93\% on the cross-subject split of the NTU-RGB+D 60 dataset, and 90.1\% on the cross-subject benchmark of the NTU-RGB+D 120 dataset. Code is available at github.com/lizaowo/HPI-GCN.

📄 PDF Abstract BibTeX arXiv:2305.18710

Code (1)

lizaowo/hpi-gcn 공식 구현 pytorch

Tasks

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Focus 설명 없음

Similar Papers 제목 키워드 기반

A Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition

2020-05-01 · ICIAI 2020: Proceedings of the 2020 the 4th International Conference on Innovation in Artificial Intelligence 2020 5 · Xiaolu Ding, Kai Yang, Wai Chen

Action recognition with skeleton data is a challenging task in computer vision. Graph convolutional networks (GCNs), which directly model the human body skeletons as the graph structure, have achieved remarkable performa…

Action RecognitionSkeleton Based Action Recognition

Multi-scale spatial–temporal convolutional neural network for skeleton-based action recognition

2023-05-12 · journal 2023 5 · Qin Cheng, Jun Cheng, Ziliang Ren, Qieshi Zhang 외

The skeleton data convey significant information for action recognition since they can robustly against cluttered backgrounds and illumination variation. In recent years, due to the limited ability to extract spatial–tem…

Action RecognitionSkeleton Based Action Recognition

Dynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition

2021-12-20 · Jinfeng Wei, Yunxin Wang, Mengli Guo, Pei Lv 외

Graph convolutional networks (GCNs) based methods have achieved advanced performance on skeleton-based action recognition task. However, the skeleton graph cannot fully represent the motion information contained in skele…

Action RecognitionSkeleton Based Action Recognition

Progressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition

2020-11-11 · Negar Heidari, Alexandros Iosifidis

Graph convolutional networks (GCNs) have been very successful in skeleton-based human action recognition where the sequence of skeletons is modeled as a graph. However, most of the GCN-based methods in this area train a …

Action RecognitionTemporal Action Localization

STEP CATFormer: Spatial-Temporal Effective Body-Part Cross Attention Transformer for Skeleton-based Action Recognition

2023-12-06 · Nguyen Huu Bao Long

Graph convolutional networks (GCNs) have been widely used and achieved remarkable results in skeleton-based action recognition. We think the key to skeleton-based action recognition is a skeleton hanging in frames, so we…

Action RecognitionSkeleton Based Action Recognition