Deep-Aligned Convolutional Neural Network for Skeleton-based Action Recognition and Segmentation
Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from them in their designs. However, a shortcoming of such applications is the general lack of spatial relationships between the input features in such data types. Besides, non-uniform temporal scalings is a common issue in skeleton-based data streams which leads to having different input sizes even within one specific action category. In this work, we propose a novel deep-aligned convolutional neural network (DACNN) to tackle the above challenges for the particular problem of SBARS. Our network is designed by introducing a new type of filters in the context of CNNs which are trained based on their alignments to the local subsequences in the inputs. These filters result in efficient predictions as well as learning interpretable patterns in the data. We empirically evaluate our framework on real-world benchmarks showing that the proposed DACNN algorithm obtains a competitive performance compared to the state-of-the-art while benefiting from a less complicated yet more interpretable model.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionSkeleton Based Action RecognitionSimilar Papers 제목 키워드 기반
Action Segmentation Using 2D Skeleton Heatmaps and Multi-Modality Fusion
This paper presents a 2D skeleton-based action segmentation method with applications in fine-grained human activity recognition. In contrast with state-of-the-art methods which directly take sequences of 3D skeleton coor…
Action SegmentationActivity RecognitionHuman Activity RecognitionSegmentation+1Adaptive Local-Component-aware Graph Convolutional Network for One-shot Skeleton-based Action Recognition
Skeleton-based action recognition receives increasing attention because the skeleton representations reduce the amount of training data by eliminating visual information irrelevant to actions. To further improve the samp…
Action RecognitionMeta-LearningOne-Shot LearningSkeleton Based Action RecognitionJOLO-GCN: Mining Joint-Centered Light-Weight Information for Skeleton-Based Action Recognition
Skeleton-based action recognition has attracted research attentions in recent years. One common drawback in currently popular skeleton-based human action recognition methods is that the sparse skeleton information alone …
Action RecognitionOptical Flow EstimationSkeleton Based Action RecognitionTemporal Action LocalizationPredictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition
In skeleton-based action recognition, graph convolutional networks (GCNs), which model human body skeletons using graphical components such as nodes and connections, have achieved remarkable performance recently. However…
Action RecognitionSkeleton Based Action RecognitionGraph Edge Convolutional Neural Networks for Skeleton Based Action Recognition
This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action rec…
Action RecognitionPose EstimationSkeleton Based Action RecognitionTemporal Action Localization