Space-Time Representation of People Based on 3D Skeletal Data: A Review
Spatiotemporal human representation based on 3D visual perception data is a rapidly growing research area. Based on the information sources, these representations can be broadly categorized into two groups based on RGB-D information or 3D skeleton data. Recently, skeleton-based human representations have been intensively studied and kept attracting an increasing attention, due to their robustness to variations of viewpoint, human body scale and motion speed as well as the realtime, online performance. This paper presents a comprehensive survey of existing space-time representations of people based on 3D skeletal data, and provides an informative categorization and analysis of these methods from the perspectives, including information modality, representation encoding, structure and transition, and feature engineering. We also provide a brief overview of skeleton acquisition devices and construction methods, enlist a number of public benchmark datasets with skeleton data, and discuss potential future research directions.
Code (1)
Tasks
Feature EngineeringSimilar Papers 제목 키워드 기반
Panoptic Studio: A Massively Multiview System for Social Motion Capture
We present an approach to capture the 3D structure and motion of a group of people engaged in a social interaction. The core challenges in capturing social interactions are: (1) occlusion is functional and frequent; (2) …
Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group
Recently introduced cost-effective depth sensors coupled with the real-time skeleton estimation algorithm of Shotton et al. have generated a renewed interest in skeleton-based human action recognition. Most of the existi…
Action RecognitionDynamic Time WarpingGeneral ClassificationSkeleton Based Action Recognition+1Let me join you! Real-time F-formation recognition by a socially aware robot
This paper presents a novel architecture to detect social groups in real-time from a continuous image stream of an ego-vision camera. F-formation defines social orientations in space where two or more person tends to com…
Outlier DetectionRolling Rotations for Recognizing Human Actions from 3D Skeletal Data
Recently, skeleton-based human action recognition has been receiving significant attention from various research communities due to the availability of depth sensors and real-time depth-based 3D skeleton estimation algor…
Action RecognitionGeneral ClassificationSkeleton Based Action RecognitionTemporal Action LocalizationA Two-stream Convolutional Network for Musculoskeletal and Neurological Disorders Prediction
Musculoskeletal and neurological disorders are the most common causes of walking problems among older people, and they often lead to diminished quality of life. Analyzing walking motion data manually requires trained pro…
Time SeriesTime Series AnalysisVocal Bursts Valence Prediction