Bayesian Graph Convolution LSTM for Skeleton Based Action Recognition
We propose a framework for recognizing human actions from skeleton data by modeling the underlying dynamic process that generates the motion pattern. We capture three major factors that contribute to the complexity of the motion pattern including spatial dependencies among body joints, temporal dependencies of body poses, and variation among subjects in action execution. We utilize graph convolution to extract structure-aware feature representation from pose data by exploiting the skeleton anatomy. Long short-term memory (LSTM) network is then used to capture the temporal dynamics of the data. Finally, the whole model is extended under the Bayesian framework to a probabilistic model in order to better capture the stochasticity and variation in the data. An adversarial prior is developed to regularize the model parameters to improve the generalization of the model. A Bayesian inference problem is formulated to solve the classification task. We demonstrate the benefit of this framework in several benchmark datasets with recognition under various generalization conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionAnatomyBayesian InferenceSkeleton Based Action RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition
Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spa…
Action RecognitionSkeleton Based Action RecognitionTemporal Action LocalizationGCN-DevLSTM: Path Development for Skeleton-Based Action Recognition
Skeleton-based action recognition (SAR) in videos is an important but challenging task in computer vision. The recent state-of-the-art (SOTA) models for SAR are primarily based on graph convolutional neural networks (GCN…
Action RecognitionDimensionality ReductionSkeleton Based Action RecognitionFocusing and Diffusion: Bidirectional Attentive Graph Convolutional Networks for Skeleton-based Action Recognition
A collection of approaches based on graph convolutional networks have proven success in skeleton-based action recognition by exploring neighborhood information and dense dependencies between intra-frame joints. However, …
Action RecognitionSkeleton Based Action RecognitionRegularizing Long Short Term Memory With 3D Human-Skeleton Sequences for Action Recognition
This paper argues that large-scale action recognition in video can be greatly improved by providing an additional modality in training data -- namely, 3D human-skeleton sequences -- aimed at complementing poorly represen…
Action RecognitionTemporal Action LocalizationNon-local Graph Convolutional Network for joint Activity Recognition and Motion Prediction
3D skeleton-based motion prediction and activity recognition are two interwoven tasks in human behaviour analysis. In this work, we propose a motion context modeling methodology that provides a new way to combine the adv…
Activity RecognitionDecoderHuman motion predictionmotion prediction+1