Bookworm continual learning: beyond zero-shot learning and continual learning
We propose bookworm continual learning(BCL), a flexible setting where unseen classes can be inferred via a semantic model, and the visual model can be updated continually. Thus BCL generalizes both continual learning (CL) and zero-shot learning (ZSL). We also propose the bidirectional imagination (BImag) framework to address BCL where features of both past and future classes are generated. We observe that conditioning the feature generator on attributes can actually harm the continual learning ability, and propose two variants (joint class-attribute conditioning and asymmetric generation) to alleviate this problem.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeContinual LearningZero-Shot LearningSimilar Papers 제목 키워드 기반
Dynamic VAEs with Generative Replay for Continual Zero-shot Learning
Continual zero-shot learning(CZSL) is a new domain to classify objects sequentially the model has not seen during training. It is more suitable than zero-shot and continual learning approaches in real-case scenarios when…
Continual LearningZero-Shot LearningContinual Learning Improves Zero-Shot Action Recognition
Zero-shot action recognition requires a strong ability to generalize from pre-training and seen classes to novel unseen classes. Similarly, continual learning aims to develop models that can generalize effectively and le…
Action RecognitionContinual LearningZero-Shot Action RecognitionZero-Shot LearningMemory-Free Continual Learning with Null Space Adaptation for Zero-Shot Vision-Language Models
Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalization, enabling deployment in a wide range of real-world tasks without additional task-specific training. However, …
Zero-shot GeneralizationContinual LearningCLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization
Language agents have shown some ability to interact with an external environment, e.g., a virtual world such as ScienceWorld, to perform complex tasks, e.g., growing a plant, without the startup costs of reinforcement le…
Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting
Vision-language models (VLMs), spanning predictive architectures to generative Multimodal Large Language Models (MLLMs), have revolutionized artificial intelligence through powerful cross-modal alignment and zero-shot ge…
Compositional Zero-Shot LearningZero-shot GeneralizationContinual Learning