Gesture Recognition Portfolios for Personalization
Human gestures, similar to speech and handwriting, are often unique to the individual. Training a generic classifier applicable to everyone can be very difficult and as such, it has become a standard to use personalized classifiers in speech and handwriting recognition. In this paper, we address the problem of personalization in the context of gesture recognition, and propose a novel and extremely efficient way of doing personalization. Unlike conventional personalization methods which learn a single classifier that later gets adapted, our approach learns a set (portfolio) of classifiers during training, one of which is selected for each test subject based on the personalization data. We formulate classifier personalization as a selection problem and propose several algorithms to compute the set of candidate classifiers. Our experiments show that such an approach is much more efficient than adapting the classifier parameters but can still achieve comparable or better results.
Code (0)
등록된 구현이 없습니다.
Tasks
Gesture RecognitionHandwriting RecognitionSimilar Papers 제목 키워드 기반
Personalizing Gesture Recognition Using Hierarchical Bayesian Neural Networks
Building robust classifiers trained on data susceptible to group or subject-specific variations is a challenging pattern recognition problem. We develop hierarchical Bayesian neural networks to capture subject-specific v…
Active LearningGesture RecognitionBridging Generalization and Personalization in Human Activity Recognition via On-Device Few-Shot Learning
Human Activity Recognition (HAR) with different sensing modalities requires both strong generalization across diverse users and efficient personalization for individuals. However, conventional HAR models often fail to ge…
Human Activity RecognitionFew-Shot LearningPersonaGesture: Single-Reference Co-Speech Gesture Personalization for Unseen Speakers
We propose PersonaGesture, a diffusion-based pipeline for single-reference co-speech gesture personalization of unseen speakers. Given target speech and one motion clip from a new speaker, the model must synthesize gestu…
Simultaneous Segmentation and Recognition: Towards more accurate Ego Gesture Recognition
Ego hand gestures can be used as an interface in AR and VR environments. While the context of an image is important for tasks like scene understanding, object recognition, image caption generation and activity recognitio…
Activity RecognitionCaption GenerationGesture RecognitionHand Gesture Recognition+4Micro-gesture Online Recognition using Learnable Query Points
In this paper, we briefly introduce the solution developed by our team, HFUT-VUT, for the Micro-gesture Online Recognition track in the MiGA challenge at IJCAI 2024. The Micro-gesture Online Recognition task involves ide…
Action Detection