MoTiC: Momentum Tightness and Contrast for Few-Shot Class-Incremental Learning
Few-Shot Class-Incremental Learning (FSCIL) must contend with the dual challenge of learning new classes from scarce samples while preserving old class knowledge. Existing methods use the frozen feature extractor and class-averaged prototypes to mitigate against catastrophic forgetting and overfitting. However, new-class prototypes suffer significant estimation bias due to extreme data scarcity, whereas base-class prototypes benefit from sufficient data. In this work, we theoretically demonstrate that aligning the new-class priors with old-class statistics via Bayesian analysis reduces variance and improves prototype accuracy. Furthermore, we propose large-scale contrastive learning to enforce cross-category feature tightness. To further enrich feature diversity and inject prior information for new-class prototypes, we integrate momentum self-supervision and virtual categories into the Momentum Tightness and Contrast framework (MoTiC), constructing a feature space with rich representations and enhanced interclass cohesion. Experiments on three FSCIL benchmarks produce state-of-the-art performances, particularly on the fine-grained task CUB-200, validating our method's ability to reduce estimation bias and improve incremental learning robustness.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Class-Incremental LearningContrastive LearningSimilar Papers 제목 키워드 기반
Contrastive Learning-based Multi Modal Architecture for Emoticon Prediction by Employing Image-Text Pairs
The emoticons are symbolic representations that generally accompany the textual content to visually enhance or summarize the true intention of a written message. Although widely utilized in the realm of social media, the…
mcBERT: Momentum Contrastive Learning with BERT for Zero-Shot Slot Filling
Zero-shot slot filling has received considerable attention to cope with the problem of limited available data for the target domain. One of the important factors in zero-shot learning is to make the model learn generaliz…
Contrastive Learningslot-fillingSlot FillingZero-Shot Learning+1Supervised Momentum Contrastive Learning for Few-Shot Classification
Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate …
ClassificationContrastive LearningFew-Shot LearningGeneral Classification+2Experimental Evidence Supporting a New "Osmosis Law & Theory" Derived New Formula that Improves van't Hoff Osmotic Pressure Equation
Experimental data were used to support a new concept of osmotic force and a new osmotic law that can explain the osmotic process without the difficulties encountered with van't Hoff osmotic pressure theory. Derived new o…
MiscellaneousSentiment Expression via Emoticons on Social Media
Emoticons (e.g., :) and :( ) have been widely used in sentiment analysis and other NLP tasks as features to ma- chine learning algorithms or as entries of sentiment lexicons. In this paper, we argue that while emoticons …
ClusteringSentiment AnalysisSentiment Classification