Real-time Online Action Detection Forests using Spatio-temporal Contexts
Online action detection (OAD) is challenging since 1) robust yet computationally expensive features cannot be straightforwardly used due to the real-time processing requirements and 2) the localization and classification of actions have to be performed even before they are fully observed. We propose a new random forest (RF)-based online action detection framework that addresses these challenges. Our algorithm uses computationally efficient skeletal joint features. High accuracy is achieved by using robust convolutional neural network (CNN)-based features which are extracted from the raw RGBD images, plus the temporal relationships between the current frame of interest, and the past and future frames. While these high-quality features are not available in real-time testing scenario, we demonstrate that they can be effectively exploited in training RF classifiers: We use these spatio-temporal contexts to craft RF's new split functions improving RFs' leaf node statistics. Experiments with challenging MSRAction3D, G3D, and OAD datasets demonstrate that our algorithm significantly improves the accuracy over the state-of-the-art online action detection algorithms while achieving the real-time efficiency of existing skeleton-based RF classifiers.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionOnline Action DetectionSimilar Papers 제목 키워드 기반
Transition Forests: Learning Discriminative Temporal Transitions for Action Recognition and Detection
A human action can be seen as transitions between one's body poses over time, where the transition depicts a temporal relation between two poses. Recognizing actions thus involves learning a classifier sensitive to these…
Action DetectionAction RecognitionSpatio-Temporal Action LocalizationTemporal Action LocalizationMondrian Forests: Efficient Online Random Forests
Ensembles of randomized decision trees, usually referred to as random forests, are widely used for classification and regression tasks in machine learning and statistics. Random forests achieve competitive predictive per…
A Contextual Word Embedding for Arabic Sarcasm Detection with Random Forests
Sarcasm detection is of great importance in understanding people’s true sentiments and opinions. Many online feedbacks, reviews, social media comments, etc. are sarcastic. Several researches have already been done in thi…
Data AugmentationSarcasm DetectionQ-learning with online random forests
$Q$-learning is the most fundamental model-free reinforcement learning algorithm. Deployment of $Q$-learning requires approximation of the state-action value function (also known as the $Q$-function). In this work, we pr…
Q-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Evaluation of machine-learning models to measure individualized treatment effects from randomized clinical trial data with time-to-event outcomes
In randomized clinical trials, regression models can be used to explore the relationships between patients' variables (e.g., clinical, pathological or lifestyle variables, and also biomarker or genomics data) and the mag…