Human Action Recognition Based on Spatial-Temporal Attention
Many state-of-the-art methods of recognizing human action are based on attention mechanism, which shows the importance of attention mechanism in action recognition. With the rapid development of neural networks, human action recognition has been achieved great improvement by using convolutional neural networks (CNN) or recurrent neural networks (RNN). In this paper, we propose a model based on spatial-temporal attention weighted LSTM. This model pays attention to the key part in each video frame, and also focuses on the important frames in each video sequence, thus the most important theme for our model is how to find out the key point spatially and the key frames temporally. We show a feasible architecture which can solve those two problems effectively and achieve a satisfactory result. Our model is trained and tested on three datasets including UCF-11, UCF-101, and HMDB51. Those results demonstrate a high performance of our model in human action recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionTemporal Action LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data
Human action recognition is an important task in computer vision. Extracting discriminative spatial and temporal features to model the spatial and temporal evolutions of different actions plays a key role in accomplishin…
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationDecoupled Spatial-Temporal Attention Network for Skeleton-Based Action Recognition
Dynamic skeletal data, represented as the 2D/3D coordinates of human joints, has been widely studied for human action recognition due to its high-level semantic information and environmental robustness. However, previous…
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationUnderstanding Spatio-Temporal Relations in Human-Object Interaction using Pyramid Graph Convolutional Network
Human activities recognition is an important task for an intelligent robot, especially in the field of human-robot collaboration, it requires not only the label of sub-activities but also the temporal structure of the ac…
Action RecognitionAction SegmentationHuman-Object Interaction DetectionHuman Activity Recognition Using Cascaded Dual Attention CNN and Bi-Directional GRU Framework
Vision-based human activity recognition has emerged as one of the essential research areas in video analytics domain. Over the last decade, numerous advanced deep learning algorithms have been introduced to recognize com…
Action RecognitionActivity RecognitionComputational EfficiencyHuman Activity RecognitionOn the spatial attention in Spatio-Temporal Graph Convolutional Networks for skeleton-based human action recognition
Graph convolutional networks (GCNs) achieved promising performance in skeleton-based human action recognition by modeling a sequence of skeletons as a spatio-temporal graph. Most of the recently proposed GCN-based method…
Action RecognitionTemporal Action Localization