Incremental Meta-Learning via Indirect Discriminant Alignment

2020-02-11 · Qing Liu, Orchid Majumder, Alessandro Achille, Avinash Ravichandran, Rahul Bhotika, Stefano Soatto

Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sampled from a large dataset and a testing phase, where the meta-learner leverages its learnt internal representation for a specific few-shot task involving classes which were not seen during the meta-training phase. To the best of our knowledge, all such meta-learning methods use a single base dataset for meta-training to sample tasks from and do not adapt the algorithm after meta-training. This strategy may not scale to real-world use-cases where the meta-learner does not potentially have access to the full meta-training dataset from the very beginning and we need to update the meta-learner in an incremental fashion when additional training data becomes available. Through our experimental setup, we develop a notion of incremental learning during the meta-training phase of meta-learning and propose a method which can be used with multiple existing metric-based meta-learning algorithms. Experimental results on benchmark dataset show that our approach performs favorably at test time as compared to training a model with the full meta-training set and incurs negligible amount of catastrophic forgetting

📄 PDF Abstract BibTeX arXiv:2002.04162

Code (0)

등록된 구현이 없습니다.

Tasks

Incremental Learning Meta-Learning

Methods 이 논문이 사용한 방법론

Test 설명 없음

Incremental Few-Shot Meta-Learning via Indirect Discriminant Alignment

2020-08-01 · ECCV 2020 8 · Qing Liu, Orchid Majumder, Alessandro Achille, Avinash Ravichandran 외

We propose a method to train a model so it can learn new classification tasks while improving with each task solved. This amounts to combining meta-learning with incremental learning. Different tasks can have disjoint cl…

Few-Shot Learning Incremental Learning Meta-Learning

Incremental Fast Subclass Discriminant Analysis

2020-02-11 · Kateryna Chumachenko, Jenni Raitoharju, Moncef Gabbouj, Alexandros Iosifidis

This paper proposes an incremental solution to Fast Subclass Discriminant Analysis (fastSDA). We present an exact and an approximate linear solution, along with an approximate kernelized variant. Extensive experiments on…

Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class-Incremental Learning

2023-02-02 · ICLR 2023 2 · Yibo Yang, Haobo Yuan, Xiangtai Li, Zhouchen Lin 외

Few-shot class-incremental learning (FSCIL) has been a challenging problem as only a few training samples are accessible for each novel class in the new sessions. Finetuning the backbone or adjusting the classifier proto…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning

Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning

2023-02-06 · Yibo Yang, Haobo Yuan, Xiangtai Li, Zhouchen Lin 외

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning

MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning

2022-01-01 · CVPR 2022 1 · Zhixiang Chi, Li Gu, Huan Liu, Yang Wang 외

In this paper, we tackle the problem of few-shot class incremental learning (FSCIL). FSCIL aims to incrementally learn new classes with only a few samples in each class. Most existing methods only consider the increm…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning+1