Synthesized Feature Based Few-Shot Class-Incremental Learning on a Mixture of Subspaces
Few-shot class incremental learning (FSCIL) aims to incrementally add sets of novel classes to a well-trained base model in multiple training sessions with the restriction that only a few novel instances are available per class. While learning novel classes, FSCIL methods gradually forget base (old) class training and overfit to a few novel class samples. Existing approaches have addressed this problem by computing the class prototypes from the visual or semantic word vector domain. In this paper, we propose addressing this problem using a mixture of subspaces. Subspaces define the cluster structure of the visual domain and help to describe the visual and semantic domain considering the overall distribution of the data. Additionally, we propose to employ a variational autoencoder (VAE) to generate synthesized visual samples for augmenting pseudo-feature while learning novel classes incrementally. The combined effect of the mixture of subspaces and synthesized features reduces the forgetting and overfitting problem of FSCIL. Extensive experiments on three image classification datasets show that our proposed method achieves competitive results compared to state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental Learningimage-classificationImage ClassificationIncremental LearningSimilar Papers 제목 키워드 기반
Brain-inspired analogical mixture prototypes for few-shot class-incremental learning
Few-shot class-incremental learning (FSCIL) poses significant challenges for artificial neural networks due to the need to efficiently learn from limited data while retaining knowledge of previously learned tasks. Inspir…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningGeneralized Few-Shot Continual Learning with Contrastive Mixture of Adapters
The goal of Few-Shot Continual Learning (FSCL) is to incrementally learn novel tasks with limited labeled samples and preserve previous capabilities simultaneously, while current FSCL methods are all for the class-increm…
Continual LearningContrastive LearningDomain GeneralizationRepresentation LearningLearning Prompt with Distribution-Based Feature Replay for Few-Shot Class-Incremental Learning
Few-shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes based on very limited training data without forgetting the old ones encountered. Existing studies solely relied on pure visual networks, …
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+1Class Knowledge Overlay to Visual Feature Learning for Zero-Shot Image Classification
New categories can be discovered by transforming semantic features into synthesized visual features without corresponding training samples in zero-shot image classification. Although significant progress has been made in…
General Classificationimage-classificationImage ClassificationTriplet+2Catastrophic Forgetting Resilient One-Shot Incremental Federated Learning
Modern big-data systems generate massive, heterogeneous, and geographically dispersed streams that are large-scale and privacy-sensitive, making centralization challenging. While federated learning (FL) provides a privac…
Federated Learning