Real-Time Online Skeleton Extraction and Gesture Recognition on Pepper
We present a multi-stage pipeline for simple gesture recognition. The novelty of our approach is the association of different technologies, resulting in the first real-time system as of now to conjointly extract skeletons and recognise gesture on a Pepper robot. For this task, Pepper has been augmented with an embedded GPU for running deep CNNs and a fish-eye camera to capture whole scene interaction. We show in this article that real-case scenarios are challenging, and the state-of-the-art approaches hardly deal with unknown human gestures. We present here a way to handle such cases.
Code (0)
등록된 구현이 없습니다.
Tasks
Gesture RecognitionGPUSimilar Papers 제목 키워드 기반
SHREC 2021: Track on Skeleton-based Hand Gesture Recognition in the Wild
Gesture recognition is a fundamental tool to enable novel interaction paradigms in a variety of application scenarios like Mixed Reality environments, touchless public kiosks, entertainment systems, and more. Recognition…
Action RecognitionGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+1Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition
Micro-gesture analysis attracts increasing attention for inferring spontaneous emotion from subtle body movements. Micro-gesture online recognition, which localizes and classifies each gesture instance in untrimmed video…
Action DetectionOnline hand gesture recognition using Continual Graph Transformers
Online continuous action recognition has emerged as a critical research area due to its practical implications in real-world applications, such as human-computer interaction, healthcare, and robotics. Among various modal…
Action RecognitionContinual LearningGesture RecognitionHand Gesture Recognition+1OMG-Bench: A New Challenging Benchmark for Skeleton-based Online Micro Hand Gesture Recognition
Online micro gesture recognition from hand skeletons is critical for VR/AR interaction but faces challenges due to limited public datasets and task-specific algorithms. Micro gestures involve subtle motion patterns, whic…
Hand Gesture RecognitionOn-device Real-time Hand Gesture Recognition
We present an on-device real-time hand gesture recognition (HGR) system, which detects a set of predefined static gestures from a single RGB camera. The system consists of two parts: a hand skeleton tracker and a gesture…
Gesture RecognitionHand Gesture RecognitionHand-Gesture Recognition