A Spatial-Temporal Transformer based Framework For Human Pose Assessment And Correction in Education Scenarios
Human pose assessment and correction play a crucial role in applications across various fields, including computer vision, robotics, sports analysis, healthcare, and entertainment. In this paper, we propose a Spatial-Temporal Transformer based Framework (STTF) for human pose assessment and correction in education scenarios such as physical exercises and science experiment. The framework comprising skeletal tracking, pose estimation, posture assessment, and posture correction modules to educate students with professional, quick-to-fix feedback. We also create a pose correction method to provide corrective feedback in the form of visual aids. We test the framework with our own dataset. It comprises (a) new recordings of five exercises, (b) existing recordings found on the internet of the same exercises, and (c) corrective feedback on the recordings by professional athletes and teachers. Results show that our model can effectively measure and comment on the quality of students' actions. The STTF leverages the power of transformer models to capture spatial and temporal dependencies in human poses, enabling accurate assessment and effective correction of students' movements.
Code (0)
등록된 구현이 없습니다.
Tasks
Pose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Gravity-informed Spatiotemporal Transformer for Human Activity Intensity Prediction
Human activity intensity prediction is a crucial to many location-based services. Although tremendous progress has been made to model dynamic spatiotemporal patterns of human activity, most existing methods, including sp…
HSTFormer: Hierarchical Spatial-Temporal Transformers for 3D Human Pose Estimation
Transformer-based approaches have been successfully proposed for 3D human pose estimation (HPE) from 2D pose sequence and achieved state-of-the-art (SOTA) performance. However, current SOTAs have difficulties in modeling…
3D Human Pose EstimationPose EstimationTowards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers
3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, su…
3D Human Pose EstimationPose EstimationScene UnderstandingDisentangling Spatial-Temporal Functional Brain Networks via Twin-Transformers
How to identify and characterize functional brain networks (BN) is fundamental to gain system-level insights into the mechanisms of brain organizational architecture. Current functional magnetic resonance (fMRI) analysis…
Decoding Human Attentive States from Spatial-temporal EEG Patches Using Transformers
Learning the spatial topology of electroencephalogram (EEG) channels and their temporal dynamics is crucial for decoding attention states. This paper introduces EEG-PatchFormer, a transformer-based deep learning framewor…
Brain Computer InterfaceEEGElectroencephalogram (EEG)