paper-with-me

홈 › Papers

Meta-Learned Attribute Self-Interaction Network for Continual and Generalized Zero-Shot Learning

2023-12-02 · Vinay K Verma, Nikhil Mehta, Kevin J Liang, Aakansha Mishra, Lawrence Carin

Zero-shot learning (ZSL) is a promising approach to generalizing a model to categories unseen during training by leveraging class attributes, but challenges remain. Recently, methods using generative models to combat bias towards classes seen during training have pushed state of the art, but these generative models can be slow or computationally expensive to train. Also, these generative models assume that the attribute vector of each unseen class is available a priori at training, which is not always practical. Additionally, while many previous ZSL methods assume a one-time adaptation to unseen classes, in reality, the world is always changing, necessitating a constant adjustment of deployed models. Models unprepared to handle a sequential stream of data are likely to experience catastrophic forgetting. We propose a Meta-learned Attribute self-Interaction Network (MAIN) for continual ZSL. By pairing attribute self-interaction trained using meta-learning with inverse regularization of the attribute encoder, we are able to outperform state-of-the-art results without leveraging the unseen class attributes while also being able to train our models substantially faster (>100x) than expensive generative-based approaches. We demonstrate this with experiments on five standard ZSL datasets (CUB, aPY, AWA1, AWA2, and SUN) in the generalized zero-shot learning and continual (fixed/dynamic) zero-shot learning settings. Extensive ablations and analyses demonstrate the efficacy of various components proposed.

📄 PDF Abstract BibTeX arXiv:2312.01167

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeGeneralized Zero-Shot LearningMeta-LearningZero-Shot Learning

Similar Papers 제목 키워드 기반

Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot Learning

2021-02-23 · Vinay Kumar Verma, Kevin Liang, Nikhil Mehta, Lawrence Carin

Zero-shot learning (ZSL) has been shown to be a promising approach to generalizing a model to categories unseen during training by leveraging class attributes, but challenges still remain. Recently, methods using generat…

AttributeGeneralized Zero-Shot LearningMeta-LearningZero-Shot Learning

Automating Continual Learning

2023-12-01 · Kazuki Irie, Róbert Csordás, Jürgen Schmidhuber

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF) -- p…

Continual Learningimage-classificationImage ClassificationMeta-Learning+1

Meta-Consolidation for Continual Learning

2020-10-01 · NeurIPS 2020 12 · K J Joseph, Vineeth N. Balasubramanian

The ability to continuously learn and adapt itself to new tasks, without losing grasp of already acquired knowledge is a hallmark of biological learning systems, which current deep learning systems fall short of. In this…

Continual Learning

Self-Attention Meta-Learner for Continual Learning

2021-01-28 · Ghada Sokar, Decebal Constantin Mocanu, Mykola Pechenizkiy

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optim…

Continual LearningSplit-CIFAR-10Split-MNIST

Dynamic VAEs with Generative Replay for Continual Zero-shot Learning

2021-04-26 · Subhankar Ghosh

Continual zero-shot learning(CZSL) is a new domain to classify objects sequentially the model has not seen during training. It is more suitable than zero-shot and continual learning approaches in real-case scenarios when…

Continual LearningZero-Shot Learning