Online Action Recognition for Human Risk Prediction with Anticipated Haptic Alert via Wearables
This paper proposes a framework that combines online human state estimation, action recognition and motion prediction to enable early assessment and prevention of worker biomechanical risk during lifting tasks. The framework leverages the NIOSH index to perform online risk assessment, thus fitting real-time applications. In particular, the human state is retrieved via inverse kinematics/dynamics algorithms from wearable sensor data. Human action recognition and motion prediction are achieved by implementing an LSTM-based Guided Mixture of Experts architecture, which is trained offline and inferred online. With the recognized actions, a single lifting activity is divided into a series of continuous movements and the Revised NIOSH Lifting Equation can be applied for risk assessment. Moreover, the predicted motions enable anticipation of future risks. A haptic actuator, embedded in the wearable system, can alert the subject of potential risk, acting as an active prevention device. The performance of the proposed framework is validated by executing real lifting tasks, while the subject is equipped with the iFeel wearable system.
Code (1)
Tasks
Action RecognitionMixture-of-Expertsmotion predictionState EstimationTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessment
Recognition of human actions and associated interactions with objects and the environment is an important problem in computer vision due to its potential applications in a variety of domains. The most versatile methods c…
Action RecognitionTemporal Action LocalizationRisk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction
This paper presents a novel online framework for safe crowd-robot interaction based on risk-sensitive stochastic optimal control, wherein the risk is modeled by the entropic risk measure. The sampling-based model predict…
Model Predictive ControlTrajectory ForecastingBridging the gap between Human Action Recognition and Online Action Detection
Action recognition, early prediction, and online action detection are complementary disciplines that are often studied independently. Most online action detection networks use a pre-trained feature extractor, which might…
Action DetectionAction RecognitionKnowledge DistillationOnline Action Detection+1Online Action Recognition based on Incremental Learning of Weighted Covariance Descriptors
Different from traditional action recognition based on video segments, online action recognition aims to recognize actions from unsegmented streams of data in a continuous manner. One way for online recognition is based …
Action RecognitionIncremental LearningTemporal Action LocalizationHuman Activity Recognition: A Spatio-temporal Image Encoding of 3D Skeleton Data for Online Action Detection
Human activity recognition (HAR) based on skeleton data that can be extracted from videos (Kinect for example) , or provided by a depth camera is a time series classification problem, where handling both spatial and temp…
Action DetectionActivity RecognitionHuman Activity RecognitionOnline Action Detection+2