Enhancing Few-Shot Class-Incremental Learning via Training-Free Bi-Level Modality Calibration
Few-shot Class-Incremental Learning (FSCIL) challenges models to adapt to new classes with limited samples, presenting greater difficulties than traditional classincremental learning. While existing approaches rely heavily on visual models and require additional training during base or incremental phases, we propose a training-free framework that leverages pre-trained visual-language models like CLIP. At the core of our approach is a novel Bilevel Modality Calibration (BiMC) strategy. Our framework initially performs intra-modal calibration, combining LLM-generated fine-grained category descriptions with visual prototypes from the base session to achieve precise classifier estimation. This is further complemented by inter-modal calibration that fuses pre-trained linguistic knowledge with task-specific visual priors to mitigate modality-specific biases. To enhance prediction robustness, we introduce additional metrics and strategies that maximize the utilization of limited data. Extensive experimental results demonstrate that our approach significantly outperforms existing methods. Code is available at: https://github.com/yychen016/BiMC.
Code (1)
Tasks
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Few-shot Class-incremental Learning for Classification and Object Detection: A Survey
Few-shot Class-Incremental Learning (FSCIL) presents a unique challenge in Machine Learning (ML), as it necessitates the Incremental Learning (IL) of new classes from sparsely labeled training samples without forgetting …
class-incremental learningClass Incremental LearningClass-Incremental Object DetectionFew-Shot Class-Incremental Learning+5Towards Robust Few-shot Class Incremental Learning in Audio Classification using Contrastive Representation
In machine learning applications, gradual data ingress is common, especially in audio processing where incremental learning is vital for real-time analytics. Few-shot class-incremental learning addresses challenges arisi…
Audio Classificationclass-incremental learningClass Incremental LearningContrastive Learning+2Few-Shot Class-Incremental Learning via Training-Free Prototype Calibration
Real-world scenarios are usually accompanied by continuously appearing classes with scare labeled samples, which require the machine learning model to incrementally learn new classes and maintain the knowledge of base cl…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningFew-Shot Learning+3Bias Mitigating Few-Shot Class-Incremental Learning
Few-shot class-incremental learning (FSCIL) aims at recognizing novel classes continually with limited novel class samples. A mainstream baseline for FSCIL is first to train the whole model in the base session, then free…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningBreaking Forgetting: Training-Free Few-Shot Class-Incremental Learning via Conditional Diffusion
Efforts to overcome catastrophic forgetting in Few-Shot Class-Incremental Learning (FSCIL) have primarily focused on developing more effective gradient-based optimization strategies. In contrast, little attention has bee…
Few-Shot Class-Incremental Learning