Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey
Human pose analysis has garnered significant attention within both the research community and practical applications, owing to its expanding array of uses, including gaming, video surveillance, sports performance analysis, and human-computer interactions, among others. The advent of deep learning has significantly improved the accuracy of pose capture, making pose-based applications increasingly practical. This paper presents a comprehensive survey of pose-based applications utilizing deep learning, encompassing pose estimation, pose tracking, and action recognition.Pose estimation involves the determination of human joint positions from images or image sequences. Pose tracking is an emerging research direction aimed at generating consistent human pose trajectories over time. Action recognition, on the other hand, targets the identification of action types using pose estimation or tracking data. These three tasks are intricately interconnected, with the latter often reliant on the former. In this survey, we comprehensively review related works, spanning from single-person pose estimation to multi-person pose estimation, from 2D pose estimation to 3D pose estimation, from single image to video, from mining temporal context gradually to pose tracking, and lastly from tracking to pose-based action recognition. As a survey centered on the application of deep learning to pose analysis, we explicitly discuss both the strengths and limitations of existing techniques. Notably, we emphasize methodologies for integrating these three tasks into a unified framework within video sequences. Additionally, we explore the challenges involved and outline potential directions for future research.
Code (0)
등록된 구현이 없습니다.
Tasks
2D Pose Estimation3D Pose EstimationAction RecognitionDeep LearningMulti-Person Pose EstimationPose EstimationPose TrackingSurveySimilar Papers 제목 키워드 기반
Human Pose Estimation using Motion Priors and Ensemble Models
Human pose estimation in images and videos is one of key technologies for realizing a variety of human activity recognition tasks (e.g., human-computer interaction, gesture recognition, surveillance, and video summarizat…
2D Human Pose Estimation3D Human Pose TrackingActivity RecognitionGesture Recognition+4Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups
Pose estimation, tracking, and action recognition of articulated objects from depth images are important and challenging problems, which are normally considered separately. In this paper, a unified paradigm based on Lie …
Action RecognitionPose EstimationregressionTemporal Action LocalizationTracking Human Pose by Tracking Symmetric Parts
The human body is structurally symmetric. Tracking by detection approaches for human pose suffer from double counting, where the same image evidence is used to explain two separate but symmetric parts, such as the left a…
Action RecognitionPose EstimationTemporal Action LocalizationImage based Eye Gaze Tracking and its Applications
Eye movements play a vital role in perceiving the world. Eye gaze can give a direct indication of the users point of attention, which can be useful in improving human-computer interaction. Gaze estimation in a non-intrus…
Activity RecognitionGaze EstimationSPIN: A High Speed, High Resolution Vision Dataset for Tracking and Action Recognition in Ping Pong
We introduce a new high resolution, high frame rate stereo video dataset, which we call SPIN, for tracking and action recognition in the game of ping pong. The corpus consists of ping pong play with three main annotation…
Action RecognitionPose EstimationVocal Bursts Intensity Prediction