Skeleton-based human action evaluation using graph convolutional network for monitoring Alzheimer’s progression
Human action evaluation (HAE) involves judgments about the abnormality and quality of human actions. If performed effectively, HAE based on skeleton data can be used to monitor the outcomes of behavioral therapies for Alzheimer's disease (AD). In this paper, we propose a two-task graph convolutional network (2T-GCN) to represent skeleton data for HAE tasks involving abnormality detection and quality evaluation. The network is first evaluated using the UI-PRMD dataset and demonstrates accurate abnormality detection. Regarding quality evaluation, in addition to laboratory-collected UI-PRMD data, we test the network on a set of real exercise data collected from patients with AD. A numerical score indicating the degree to which actions deviate from normal is taken to reflect the severity of AD; thus, we apply 2T-GCN to determine such scores. Experimental results show that numerical scores for certain exercises performed by patients with AD are consistent with their AD severity level as identified by clinical staff. This corroboration highlights the potential of our approach for monitoring AD and other neurodegenerative diseases.
Code (0)
등록된 구현이 없습니다.
Tasks
Action AssessmentAnomaly DetectionSimilar Papers 제목 키워드 기반
Graph Edge Convolutional Neural Networks for Skeleton Based Action Recognition
This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action rec…
Action RecognitionPose EstimationSkeleton Based Action RecognitionTemporal Action LocalizationUnifying Graph Embedding Features with Graph Convolutional Networks for Skeleton-based Action Recognition
Combining skeleton structure with graph convolutional networks has achieved remarkable performance in human action recognition. Since current research focuses on designing basic graph for representing skeleton data, thes…
Action RecognitionGraph EmbeddingSkeleton Based Action RecognitionTemporal Action LocalizationProgressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition
Graph convolutional networks (GCNs) have been very successful in skeleton-based human action recognition where the sequence of skeletons is modeled as a graph. However, most of the GCN-based methods in this area train a …
Action RecognitionTemporal Action LocalizationDynamic Hypergraph Convolutional Networks for Skeleton-Based Action Recognition
Graph convolutional networks (GCNs) based methods have achieved advanced performance on skeleton-based action recognition task. However, the skeleton graph cannot fully represent the motion information contained in skele…
Action RecognitionSkeleton Based Action RecognitionPart-based Graph Convolutional Network for Action Recognition
Human actions comprise of joint motion of articulated body parts or `gestures'. Human skeleton is intuitively represented as a sparse graph with joints as nodes and natural connections between them as edges. Graph convol…
Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization