One-Shot-Learning Gesture Recognition using HOG-HOF Features
The purpose of this paper is to describe one-shot-learning gesture recognition systems developed on the \textit{ChaLearn Gesture Dataset}. We use RGB and depth images and combine appearance (Histograms of Oriented Gradients) and motion descriptors (Histogram of Optical Flow) for parallel temporal segmentation and recognition. The Quadratic-Chi distance family is used to measure differences between histograms to capture cross-bin relationships. We also propose a new algorithm for trimming videos --- to remove all the unimportant frames from videos. We present two methods that use combination of HOG-HOF descriptors together with variants of Dynamic Time Warping technique. Both methods outperform other published methods and help narrow down the gap between human performance and algorithms on this task. The code has been made publicly available in the MLOSS repository.
Code (0)
등록된 구현이 없습니다.
Tasks
Dynamic Time WarpingGesture RecognitionOne-Shot LearningOptical Flow EstimationSimilar Papers 제목 키워드 기반
A Prototype-Based Generalized Zero-Shot Learning Framework for Hand Gesture Recognition
Hand gesture recognition plays a significant role in human-computer interaction for understanding various human gestures and their intent. However, most prior works can only recognize gestures of limited labeled classes …
Generalized Zero-Shot LearningGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+1A Probabilistic Modeling Approach to One-Shot Gesture Recognition
Gesture recognition enables a natural extension of the way we currently interact with devices. Commercially available gesture recognition systems are usually pre-trained and offer no option for customization by the user.…
Gesture RecognitionAchieving Effective Virtual Reality Interactions via Acoustic Gesture Recognition based on Large Language Models
Natural and efficient interaction remains a critical challenge for virtual reality and augmented reality (VR/AR) systems. Vision-based gesture recognition suffers from high computational cost, sensitivity to lighting con…
Gesture RecognitionZero-Shot LearningA Generalized Zero-Shot Framework for Emotion Recognition from Body Gestures
Although automatic emotion recognition from facial expressions and speech has made remarkable progress, emotion recognition from body gestures has not been thoroughly explored. People often use a variety of body language…
Emotion ClassificationEmotion RecognitionGeneralized Zero-Shot LearningGesture Recognition+2Zero-shot Prompt-based Video Encoder for Surgical Gesture Recognition
Purpose: In order to produce a surgical gesture recognition system that can support a wide variety of procedures, either a very large annotated dataset must be acquired, or fitted models must generalize to new labels (so…
Gesture RecognitionSurgical Gesture Recognition