Simple yet efficient real-time pose-based action recognition
Recognizing human actions is a core challenge for autonomous systems as they directly share the same space with humans. Systems must be able to recognize and assess human actions in real-time. In order to train corresponding data-driven algorithms, a significant amount of annotated training data is required. We demonstrated a pipeline to detect humans, estimate their pose, track them over time and recognize their actions in real-time with standard monocular camera sensors. For action recognition, we encode the human pose into a new data format called Encoded Human Pose Image (EHPI) that can then be classified using standard methods from the computer vision community. With this simple procedure we achieve competitive state-of-the-art performance in pose-based action detection and can ensure real-time performance. In addition, we show a use case in the context of autonomous driving to demonstrate how such a system can be trained to recognize human actions using simulation data.
Code (1)
Tasks
Action DetectionAction RecognitionAutonomous DrivingSkeleton Based Action RecognitionTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Real time face recognition using adaboost improved fast PCA algorithm
This paper presents an automated system for human face recognition in a real time background world for a large homemade dataset of persons face. The task is very difficult as the real time background subtraction in an im…
Face RecognitionA Real-time Hand Gesture Recognition and Human-Computer Interaction System
In this project, we design a real-time human-computer interaction system based on hand gesture. The whole system consists of three components: hand detection, gesture recognition and human-computer interaction (HCI) base…
Gesture RecognitionHand DetectionHand Gesture RecognitionHand-Gesture RecognitionSampling Strategies for Real-Time Action Recognition
Local spatio-temporal features and bag-of-features representations have become popular for action recognition. A recent trend is to use dense sampling for better performance. While many methods claimed to use dense featu…
Action RecognitionComputational EfficiencyTemporal Action LocalizationReal-Time Online Skeleton Extraction and Gesture Recognition on Pepper
We present a multi-stage pipeline for simple gesture recognition. The novelty of our approach is the association of different technologies, resulting in the first real-time system as of now to conjointly extract skeleton…
Gesture RecognitionGPUHigh Speed Human Action Recognition using a Photonic Reservoir Computer
The recognition of human actions in videos is one of the most active research fields in computer vision. The canonical approach consists in a more or less complex preprocessing stages of the raw video data, followed by a…
Action RecognitionTemporal Action Localization