Convolutional Prototype Learning for Zero-Shot Recognition
Zero-shot learning (ZSL) has received increasing attention in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. The key to ZSL is to transfer knowledge from the seen to the unseen classes via auxiliary class attribute vectors. However, the popularly learned projection functions in previous works cannot generalize well since they assume the distribution consistency between seen and unseen domains at sample-level.Besides, the provided non-visual and unique class attributes can significantly degrade the recognition performance in semantic space. In this paper, we propose a simple yet effective convolutional prototype learning (CPL) framework for zero-shot recognition. By assuming distribution consistency at task-level, our CPL is capable of transferring knowledge smoothly to recognize unseen samples.Furthermore, inside each task, discriminative visual prototypes are learned via a distance based training mechanism. Consequently, we can perform recognition in visual space, instead of semantic space. An extensive group of experiments are then carefully designed and presented, demonstrating that CPL obtains more favorable effectiveness, over currently available alternatives under various settings.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeImage CaptioningObject RecognitionRetrievalZero-Shot LearningSimilar Papers 제목 키워드 기반
CSI-Based Cross-Domain Activity Recognition via Zero-Shot Prototypical Networks
The cross-domain capability of wireless sensing is currently one of the major challenges on human activity recognition (HAR) based on the channel state information (CSI) of wireless signals. The difficulty of labeling sa…
Activity RecognitionCross-Domain Activity RecognitionHuman Activity RecognitionZero-Shot LearningUniversal Prototype Transport for Zero-Shot Action Recognition and Localization
This work addresses the problem of recognizing action categories in videos when no training examples are available. The current state-of-the-art enables such a zero-shot recognition by learning universal mappings from vi…
Action RecognitionObjectPositionTemporal Localization+3Hierarchical Prototype Learning for Zero-Shot Recognition
Zero-Shot Learning (ZSL) has received extensive attention and successes in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. Key to ZSL is to transfer knowledge from th…
AttributeImage CaptioningObject RecognitionRetrieval+1Learning Class Prototypes via Structure Alignment for Zero-Shot Recognition
Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL app…
Dictionary LearningZero-Shot LearningA Prototype-Based Generalized Zero-Shot Learning Framework for Hand Gesture Recognition
Hand gesture recognition plays a significant role in human-computer interaction for understanding various human gestures and their intent. However, most prior works can only recognize gestures of limited labeled classes …
Generalized Zero-Shot LearningGesture RecognitionHand Gesture RecognitionHand-Gesture Recognition+1