Domain-Aware Continual Zero-Shot Learning

2021-12-24 · Kai Yi, Paul Janson, Wenxuan Zhang, Mohamed Elhoseiny

Modern visual systems have a wide range of potential applications in vision tasks for natural science research, such as aiding in species discovery, monitoring animals in the wild, and so on. However, real-world vision tasks may experience changes in environmental conditions, leading to shifts in how captured images are presented. To address this issue, we introduce Domain-Aware Continual Zero-Shot Learning (DACZSL), a task to recognize images of unseen categories in continuously changing domains. Accordingly, we propose a Domain-Invariant Network (DIN) to learn factorized features for shifting domains and improved textual representation for unseen classes. DIN continually learns a global shared network for domain-invariant and task-invariant features, and per-task private networks for task-specific features. Furthermore, we enhance the dual network with class-wise learnable prompts to improve class-level text representation, thereby improving zero-shot prediction of future unseen classes. To evaluate DACZSL, we introduce two benchmarks, DomainNet-CZSL and iWildCam-CZSL. Our results show that DIN significantly outperforms existing baselines by over 5% in harmonic accuracy and over 1% in backward transfer and achieves a new SoTA.

📄 PDF Abstract BibTeX arXiv:2112.12989

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglement Zero-Shot Learning

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Dynamic VAEs with Generative Replay for Continual Zero-shot Learning

2021-04-26 · Subhankar Ghosh

Continual zero-shot learning(CZSL) is a new domain to classify objects sequentially the model has not seen during training. It is more suitable than zero-shot and continual learning approaches in real-case scenarios when…

Continual Learning Zero-Shot Learning

Boosting Open-Domain Continual Learning via Leveraging Intra-domain Category-aware Prototype

2024-08-19 · Yadong Lu, Shitian Zhao, Boxiang Yun, Dongsheng Jiang 외

Despite recent progress in enhancing the efficacy of Open-Domain Continual Learning (ODCL) in Vision-Language Models (VLM), failing to (1) correctly identify the Task-ID of a test image and (2) use only the category set …

Continual Learning

Continual Learning Improves Zero-Shot Action Recognition

2024-10-14 · Shreyank N Gowda, Davide Moltisanti, Laura Sevilla-Lara

Zero-shot action recognition requires a strong ability to generalize from pre-training and seen classes to novel unseen classes. Similarly, continual learning aims to develop models that can generalize effectively and le…

Action Recognition Continual Learning Zero-Shot Action Recognition Zero-Shot Learning

Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models

2023-03-12 · ICCV 2023 1 · Zangwei Zheng, Mingyuan Ma, Kai Wang, Ziheng Qin 외

Continual learning (CL) can help pre-trained vision-language models efficiently adapt to new or under-trained data distributions without re-training. Nevertheless, during the continual training of the Contrastive Languag…

class-incremental learning Class Incremental Learning Continual Learning Incremental Learning

Memory-Free Continual Learning with Null Space Adaptation for Zero-Shot Vision-Language Models

2025-10-24 · Yujin Jo, Taesup Kim arxiv

Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalization, enabling deployment in a wide range of real-world tasks without additional task-specific training. However, …

Zero-shot Generalization Continual Learning