Incremental Few-Shot Meta-Learning via Indirect Discriminant Alignment
We propose a method to train a model so it can learn new classification tasks while improving with each task solved. This amounts to combining meta-learning with incremental learning. Different tasks can have disjoint classes, so one cannot directly align different classifiers as done in model distillation. On the other hand, simply aligning features shared by all classes does not allow the base model sufficient flexibility to evolve to solve new tasks. We therefore indirectly align features relative to a minimal set of anchor classes. Such indirect discriminant alignment (IDA) adapts a new model to old classes without the need to re-process old data, while leaving maximum flexibility for the model to adapt to new tasks. This process enables incrementally improving the model by processing multiple learning episodes, each representing a different learning task, even with few training examples. Experiments on few-shot learning benchmarks show that this incremental approach performs favorably compared to training the model with the entire dataset at once.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningIncremental LearningMeta-LearningSimilar Papers 제목 키워드 기반
Incremental Meta-Learning via Indirect Discriminant Alignment
Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sample…
Incremental LearningMeta-LearningNeural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class-Incremental Learning
Few-shot class-incremental learning (FSCIL) has been a challenging problem as only a few training samples are accessible for each novel class in the new sessions. Finetuning the backbone or adjusting the classifier proto…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningUnlocking Zero-Shot Geospatial Reasoning via Indirect Rewards
Training robust reasoning vision-language models (VLMs) in rare domains (such as geospatial) is fundamentally constrained by supervision scarcity. While raw geospatial imagery is abundant, the amount of task-direct super…
Reinforcement LearningNeural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning
Few-shot class-incremental learning (FSCIL) has been a challenging problem as only a few training samples are accessible for each novel class in the new sessions. Finetuning the backbone or adjusting the classifier proto…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningMetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning
In this paper, we tackle the problem of few-shot class incremental learning (FSCIL). FSCIL aims to incrementally learn new classes with only a few samples in each class. Most existing methods only consider the increm…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+1