Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning
Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure information and detailed temporal dynamics features. In this paper, we propose a novel model with spatial reasoning and temporal stack learning (SR-TSL) for skeleton based action recognition, which consists of a spatial reasoning network (SRN) and a temporal stack learning network (TSLN). The SRN can capture the high-level spatial structural information within each frame by a residual graph neural network, while the TSLN can model the detailed temporal dynamics of skeleton sequences by a composition of multiple skip-clip LSTMs. During training, we propose a clip-based incremental loss to optimize the model. We perform extensive experiments on the SYSU 3D Human-Object Interaction dataset and NTU RGB+D dataset and verify the effectiveness of each network of our model. The comparison results illustrate that our approach achieves much better results than state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionGraph Neural NetworkHuman-Object Interaction DetectionSkeleton Based Action RecognitionSpatial ReasoningTemporal Action LocalizationSimilar Papers 제목 키워드 기반
One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matching
One-shot skeleton action recognition, which aims to learn a skeleton action recognition model with a single training sample, has attracted increasing interest due to the challenge of collecting and annotating large-scale…
Action RecognitionNeurosymbolic Framework for Concept-Driven Logical Reasoning in Skeleton-Based Human Action Recognition
Skeleton-based human activity recognition has achieved strong empirical performance, yet most existing models remain black boxes and difficult to interpret. In this work, we introduce a neurosymbolic formulation of skele…
Human Activity RecognitionRepresentation LearningAction UnderstandingAction RecognitionSkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognition
Fully supervised skeleton-based action recognition has achieved great progress with the blooming of deep learning techniques. However, these methods require sufficient labeled data which is not easy to obtain. In contras…
Action RecognitionDecoderSelf-supervised Skeleton-based Action RecognitionSkeleton Based Action RecognitionDynamic Spatial-temporal Hypergraph Convolutional Network for Skeleton-based Action Recognition
Skeleton-based action recognition relies on the extraction of spatial-temporal topological information. Hypergraphs can establish prior unnatural dependencies for the skeleton. However, the existing methods only focus on…
Action RecognitionSkeleton Based Action RecognitionA New Representation of Skeleton Sequences for 3D Action Recognition
This paper presents a new method for 3D action recognition with skeleton sequences (i.e., 3D trajectories of human skeleton joints). The proposed method first transforms each skeleton sequence into three clips each consi…
3D Action RecognitionAction RecognitionMulti-Task LearningSkeleton Based Action Recognition+1