paper-with-me

홈 › Papers

Strategic Base Representation Learning via Feature Augmentations for Few-Shot Class Incremental Learning

2025-01-16 · Parinita Nema, Vinod K Kurmi

Few-shot class incremental learning implies the model to learn new classes while retaining knowledge of previously learned classes with a small number of training instances. Existing frameworks typically freeze the parameters of the previously learned classes during the incorporation of new classes. However, this approach often results in suboptimal class separation of previously learned classes, leading to overlap between old and new classes. Consequently, the performance of old classes degrades on new classes. To address these challenges, we propose a novel feature augmentation driven contrastive learning framework designed to enhance the separation of previously learned classes to accommodate new classes. Our approach involves augmenting feature vectors and assigning proxy labels to these vectors. This strategy expands the feature space, ensuring seamless integration of new classes within the expanded space. Additionally, we employ a self-supervised contrastive loss to improve the separation between previous classes. We validate our framework through experiments on three FSCIL benchmark datasets: CIFAR100, miniImageNet, and CUB200. The results demonstrate that our Feature Augmentation driven Contrastive Learning framework significantly outperforms other approaches, achieving state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2501.09361

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learningClass Incremental LearningContrastive LearningFew-Shot Class-Incremental LearningIncremental LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

K-Shot Contrastive Learning of Visual Features with Multiple Instance Augmentations

2020-07-27 · Haohang Xu, Hongkai Xiong, Guo-Jun Qi

In this paper, we propose the $K$-Shot Contrastive Learning (KSCL) of visual features by applying multiple augmentations to investigate the sample variations within individual instances. It aims to combine the advantages…

Contrastive Learning

Exploring Image Augmentations for Siamese Representation Learning with Chest X-Rays

2023-01-30 · Rogier van der Sluijs, Nandita Bhaskhar, Daniel Rubin, Curtis Langlotz 외

Image augmentations are quintessential for effective visual representation learning across self-supervised learning techniques. While augmentation strategies for natural imaging have been studied extensively, medical ima…

Anomaly DetectionRepresentation LearningSelf-Supervised Learning

From Local Details to Global Context: Advancing Vision-Language Models with Attention-Based Selection

2025-05-19 · Lincan Cai, Jingxuan Kang, Shuang Li, Wenxuan Ma 외

Pretrained vision-language models (VLMs), e.g., CLIP, demonstrate impressive zero-shot capabilities on downstream tasks. Prior research highlights the crucial role of visual augmentation techniques, like random cropping,…

feature selectionOut-of-Distribution GeneralizationTest-time Adaptationzero-shot-classification+1

Frozen Feature Augmentation for Few-Shot Image Classification

2024-03-15 · CVPR 2024 1 · Andreas Bär, Neil Houlsby, Mostafa Dehghani, Manoj Kumar

Training a linear classifier or lightweight model on top of pretrained vision model outputs, so-called 'frozen features', leads to impressive performance on a number of downstream few-shot tasks. Currently, frozen featur…

ClassificationData AugmentationFew-Shot Image Classificationimage-classification+1

Disentangling the Effects of Data Augmentation and Format Transform in Self-Supervised Learning of Image Representations

2023-12-02 · Neha Kalibhat, Warren Morningstar, Alex Bijamov, Luyang Liu 외

Self-Supervised Learning (SSL) enables training performant models using limited labeled data. One of the pillars underlying vision SSL is the use of data augmentations/perturbations of the input which do not significantl…

Data AugmentationSelf-Supervised LearningTransfer Learning