paper-with-me

홈 › Papers

MoTiC: Momentum Tightness and Contrast for Few-Shot Class-Incremental Learning

2025-09-24 · Zeyu He, Shuai Huang, Yuwu Lu, Ming Zhao arxiv

Few-Shot Class-Incremental Learning (FSCIL) must contend with the dual challenge of learning new classes from scarce samples while preserving old class knowledge. Existing methods use the frozen feature extractor and class-averaged prototypes to mitigate against catastrophic forgetting and overfitting. However, new-class prototypes suffer significant estimation bias due to extreme data scarcity, whereas base-class prototypes benefit from sufficient data. In this work, we theoretically demonstrate that aligning the new-class priors with old-class statistics via Bayesian analysis reduces variance and improves prototype accuracy. Furthermore, we propose large-scale contrastive learning to enforce cross-category feature tightness. To further enrich feature diversity and inject prior information for new-class prototypes, we integrate momentum self-supervision and virtual categories into the Momentum Tightness and Contrast framework (MoTiC), constructing a feature space with rich representations and enhanced interclass cohesion. Experiments on three FSCIL benchmarks produce state-of-the-art performances, particularly on the fine-grained task CUB-200, validating our method's ability to reduce estimation bias and improve incremental learning robustness.

📄 PDF Abstract BibTeX arXiv:2509.19664

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Class-Incremental LearningContrastive Learning

Similar Papers 제목 키워드 기반

Contrastive Learning-based Multi Modal Architecture for Emoticon Prediction by Employing Image-Text Pairs

2024-08-05

The emoticons are symbolic representations that generally accompany the textual content to visually enhance or summarize the true intention of a written message. Although widely utilized in the realm of social media, the…

mcBERT: Momentum Contrastive Learning with BERT for Zero-Shot Slot Filling

2022-03-24 · Seong-Hwan Heo, WonKee Lee, Jong-Hyeok Lee

Zero-shot slot filling has received considerable attention to cope with the problem of limited available data for the target domain. One of the important factors in zero-shot learning is to make the model learn generaliz…

Contrastive Learningslot-fillingSlot FillingZero-Shot Learning+1

Supervised Momentum Contrastive Learning for Few-Shot Classification

2021-01-26 · Orchid Majumder, Avinash Ravichandran, Subhransu Maji, Alessandro Achille 외

Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate …

ClassificationContrastive LearningFew-Shot LearningGeneral Classification+2

Experimental Evidence Supporting a New "Osmosis Law & Theory" Derived New Formula that Improves van't Hoff Osmotic Pressure Equation

2012-01-02 · Rongqing Xie, Gaochao Lin, Hung-Chung Huang

Experimental data were used to support a new concept of osmotic force and a new osmotic law that can explain the osmotic process without the difficulties encountered with van't Hoff osmotic pressure theory. Derived new o…

Miscellaneous

Sentiment Expression via Emoticons on Social Media

2015-11-09 · Hao Wang, Jorge A. Castanon

Emoticons (e.g., :) and :( ) have been widely used in sentiment analysis and other NLP tasks as features to ma- chine learning algorithms or as entries of sentiment lexicons. In this paper, we argue that while emoticons …

ClusteringSentiment AnalysisSentiment Classification