Generalized Continual Zero-Shot Learning
Recently, zero-shot learning (ZSL) emerged as an exciting topic and attracted a lot of attention. ZSL aims to classify unseen classes by transferring the knowledge from seen classes to unseen classes based on the class description. Despite showing promising performance, ZSL approaches assume that the training samples from all seen classes are available during the training, which is practically not feasible. To address this issue, we propose a more generalized and practical setup for ZSL, i.e., continual ZSL (CZSL), where classes arrive sequentially in the form of a task and it actively learns from the changing environment by leveraging the past experience. Further, to enhance the reliability, we develop CZSL for a single head continual learning setting where task identity is revealed during the training process but not during the testing. To avoid catastrophic forgetting and intransigence, we use knowledge distillation and storing and replay the few samples from previous tasks using a small episodic memory. We develop baselines and evaluate generalized CZSL on five ZSL benchmark datasets for two different settings of continual learning: with and without class incremental. Moreover, CZSL is developed for two types of variational autoencoders, which generates two types of features for classification: (i) generated features at output space and (ii) generated discriminative features at the latent space. The experimental results clearly indicate the single head CZSL is more generalizable and suitable for practical applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningKnowledge DistillationZero-Shot LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot Learning
Zero-shot learning (ZSL) has been shown to be a promising approach to generalizing a model to categories unseen during training by leveraging class attributes, but challenges still remain. Recently, methods using generat…
AttributeGeneralized Zero-Shot LearningMeta-LearningZero-Shot LearningContinual Learning Improves Zero-Shot Action Recognition
Zero-shot action recognition requires a strong ability to generalize from pre-training and seen classes to novel unseen classes. Similarly, continual learning aims to develop models that can generalize effectively and le…
Action RecognitionContinual LearningZero-Shot Action RecognitionZero-Shot LearningMeta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning
Zero-shot learning (ZSL) is a promising approach to generalizing a model to categories unseen during training by leveraging class attributes, but challenges remain. Recently, methods using generative models to combat bia…
AttributeGeneralized Zero-Shot LearningMeta-LearningZero-Shot LearningAdversarial Training of Variational Auto-encoders for Continual Zero-shot Learning(A-CZSL)
Most of the existing artificial neural networks(ANNs) fail to learn continually due to catastrophic forgetting, while humans can do the same by maintaining previous tasks' performances. Although storing all the previous …
Continual LearningGeneralized Zero-Shot LearningZero-Shot LearningActive perception and disentangled representations allow continual, episodic zero and few-shot learning
Generalization is often regarded as an essential property of machine learning systems. However, perhaps not every component of a system needs to generalize. Training models for generalization typically produces entangled…
Continual LearningFew-Shot Learning