A Prototype-Based Generalized Zero-Shot Learning Framework for Hand Gesture Recognition
Hand gesture recognition plays a significant role in human-computer interaction for understanding various human gestures and their intent. However, most prior works can only recognize gestures of limited labeled classes and fail to adapt to new categories. The task of Generalized Zero-Shot Learning (GZSL) for hand gesture recognition aims to address the above issue by leveraging semantic representations and detecting both seen and unseen class samples. In this paper, we propose an end-to-end prototype-based GZSL framework for hand gesture recognition which consists of two branches. The first branch is a prototype-based detector that learns gesture representations and determines whether an input sample belongs to a seen or unseen category. The second branch is a zero-shot label predictor which takes the features of unseen classes as input and outputs predictions through a learned mapping mechanism between the feature and the semantic space. We further establish a hand gesture dataset that specifically targets this GZSL task, and comprehensive experiments on this dataset demonstrate the effectiveness of our proposed approach on recognizing both seen and unseen gestures.
Code (0)
등록된 구현이 없습니다.
Tasks
Generalized Zero-Shot LearningGesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionZero-Shot LearningSimilar Papers 제목 키워드 기반
Dual Progressive Prototype Network for Generalized Zero-Shot Learning
Generalized Zero-Shot Learning (GZSL) aims to recognize new categories with auxiliary semantic information,e.g., category attributes. In this paper, we handle the critical issue of domain shift problem, i.e., confusion b…
AttributeGeneralized Zero-Shot LearningZero-Shot LearningGeneralized Zero-Shot Learning with Deep Calibration Network
A technical challenge of deep learning is recognizing target classes without seen data. Zero-shot learning leverages semantic representations such as attributes or class prototypes to bridge source and target classes. Ex…
Generalized Zero-Shot LearningZero-Shot LearningVisual and Semantic Prototypes-Jointly Guided CNN for Generalized Zero-shot Learning
In the process of exploring the world, the curiosity constantly drives humans to cognize new things. Supposing you are a zoologist, for a presented animal image, you can recognize it immediately if you know its class. Ot…
Generalized Zero-Shot LearningOpen Set LearningZero-Shot LearningLearn to Adapt for Generalized Zero-Shot Text Classification
Generalized zero-shot text classification aims to classify textual instances from both previously seen classes and incrementally emerging unseen classes. Most existing methods generalize poorly since the learned paramete…
ClassificationGeneralized Zero-Shot LearningMeta-Learningtext-classification+3Episode-based Prototype Generating Network for Zero-Shot Learning
We introduce a simple yet effective episode-based training framework for zero-shot learning (ZSL), where the learning system requires to recognize unseen classes given only the corresponding class semantics. During train…
zero-shot-classificationZero-Shot Learning