paper-with-me

Papers

Temporal Attention-Augmented Graph Convolutional Network for Efficient Skeleton-Based Human Action Recognition

2020-10-23 · Negar Heidari, Alexandros Iosifidis

Graph convolutional networks (GCNs) have been very successful in modeling non-Euclidean data structures, like sequences of body skeletons forming actions modeled as spatio-temporal graphs. Most GCN-based action recognition methods use deep feed-forward networks with high computational complexity to process all skeletons in an action. This leads to a high number of floating point operations (ranging from 16G to 100G FLOPs) to process a single sample, making their adoption in restricted computation application scenarios infeasible. In this paper, we propose a temporal attention module (TAM) for increasing the efficiency in skeleton-based action recognition by selecting the most informative skeletons of an action at the early layers of the network. We incorporate the TAM in a light-weight GCN topology to further reduce the overall number of computations. Experimental results on two benchmark datasets show that the proposed method outperforms with a large margin the baseline GCN-based method while having 2.9 times less number of computations. Moreover, it performs on par with the state-of-the-art with up to 9.6 times less number of computations.

📄 PDF Abstract BibTeX arXiv:2010.12221

Code (0)

등록된 구현이 없습니다.

Tasks

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Methods 이 논문이 사용한 방법론

TAM TAM is designed to capture complex temporal relationships both efficiently and flexibly, It adopts an adaptive kernel instead of self-attention to capture global contextual…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

STEP CATFormer: Spatial-Temporal Effective Body-Part Cross Attention Transformer for Skeleton-based Action Recognition

2023-12-06 · Nguyen Huu Bao Long

Graph convolutional networks (GCNs) have been widely used and achieved remarkable results in skeleton-based action recognition. We think the key to skeleton-based action recognition is a skeleton hanging in frames, so we…

Action RecognitionSkeleton Based Action Recognition

An Attention-Enhanced Recurrent Graph Convolutional Network for Skeleton-Based Action Recognition

2019-11-27 · SPML '19: Proceedings of the 2019 2nd International Conference on Signal Processing and Machine Learning 2019 11 · Xiaolu Ding, Kai Yang, Wai Chen

Dynamic movements of human skeleton have attracted more and more attention as a robust modality for action recognition. As not all temporal stages and skeleton joints are informative for action recognition, and the irrel…

Action RecognitionSkeleton Based Action Recognition

On the spatial attention in Spatio-Temporal Graph Convolutional Networks for skeleton-based human action recognition

2020-11-07 · Negar Heidari, Alexandros Iosifidis

Graph convolutional networks (GCNs) achieved promising performance in skeleton-based human action recognition by modeling a sequence of skeletons as a spatio-temporal graph. Most of the recently proposed GCN-based method…

Action RecognitionTemporal Action Localization

Hierarchical Graph Convolutional Skeleton Transformer for Action Recognition

2021-09-07 · Ruwen Bai, Min Li, Bo Meng, Fengfa Li 외

Graph convolutional networks (GCNs) have emerged as dominant methods for skeleton-based action recognition. However, they still suffer from two problems, namely, neighborhood constraints and entangled spatiotemporal feat…

Action RecognitionDisentanglementSkeleton Based Action Recognition

A Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition

2020-05-01 · ICIAI 2020: Proceedings of the 2020 the 4th International Conference on Innovation in Artificial Intelligence 2020 5 · Xiaolu Ding, Kai Yang, Wai Chen

Action recognition with skeleton data is a challenging task in computer vision. Graph convolutional networks (GCNs), which directly model the human body skeletons as the graph structure, have achieved remarkable performa…

Action RecognitionSkeleton Based Action Recognition