Skeletal Movement to Color Map: A Novel Representation for 3D Action Recognition with Inception Residual Networks
We propose a novel skeleton-based representation for 3D action recognition in videos using Deep Convolutional Neural Networks (D-CNNs). Two key issues have been addressed: First, how to construct a robust representation that easily captures the spatial-temporal evolutions of motions from skeleton sequences. Second, how to design D-CNNs capable of learning discriminative features from the new representation in a effective manner. To address these tasks, a skeletonbased representation, namely, SPMF (Skeleton Pose-Motion Feature) is proposed. The SPMFs are built from two of the most important properties of a human action: postures and their motions. Therefore, they are able to effectively represent complex actions. For learning and recognition tasks, we design and optimize new D-CNNs based on the idea of Inception Residual networks to predict actions from SPMFs. Our method is evaluated on two challenging datasets including MSR Action3D and NTU-RGB+D. Experimental results indicated that the proposed method surpasses state-of-the-art methods whilst requiring less computation.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Action RecognitionAction RecognitionAction Recognition In VideosTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Evaluating the Immediate Applicability of Pose Estimation for Sign Language Recognition
Signed languages are visual languages produced by the movement of the hands, face, and body. In this paper, we evaluate representations based on skeleton poses, as these are explainable, person-independent, privacy-prese…
Pose EstimationPrivacy PreservingSign Language RecognitionMoving poselets: A discriminative and interpretable skeletal motion representation for action recognition
Given a video or time series of skeleton data, action recognition systems perform classification using cues such as motion, appearance, and pose. For the past decade, actions have been modeled using low-level feature rep…
Action RecognitionDictionary LearningMultimodal Activity RecognitionTime Series AnalysisExploiting deep residual networks for human action recognition from skeletal data
The computer vision community is currently focusing on solving action recognition problems in real videos, which contain thousands of samples with many challenges. In this process, Deep Convolutional Neural Networks (D-C…
Action RecognitionTemporal Action LocalizationHuman sensory-musculoskeletal modeling and control of whole-body movements
Coordinated human movement depends on the integration of multisensory inputs, sensorimotor transformation, and motor execution, as well as sensory feedback resulting from body-environment interaction. Building dynamic mo…
Deep Reinforcement LearningPen Spinning Hand Movement Analysis Using MediaPipe Hands
We challenged to get data about hand movement in pen spinning using MediaPipe Hands and OpenCV. The purpose is to create a system that can be used to objectively evaluate the performance of pen spinning competitions. Eva…