paper-with-me

홈 › Papers

Compositional Few-Shot Class-Incremental Learning

2024-05-27 · Yixiong Zou, Shanghang Zhang, Haichen Zhou, Yuhua Li, Ruixuan Li

Few-shot class-incremental learning (FSCIL) is proposed to continually learn from novel classes with only a few samples after the (pre-)training on base classes with sufficient data. However, this remains a challenge. In contrast, humans can easily recognize novel classes with a few samples. Cognitive science demonstrates that an important component of such human capability is compositional learning. This involves identifying visual primitives from learned knowledge and then composing new concepts using these transferred primitives, making incremental learning both effective and interpretable. To imitate human compositional learning, we propose a cognitive-inspired method for the FSCIL task. We define and build a compositional model based on set similarities, and then equip it with a primitive composition module and a primitive reuse module. In the primitive composition module, we propose to utilize the Centered Kernel Alignment (CKA) similarity to approximate the similarity between primitive sets, allowing the training and evaluation based on primitive compositions. In the primitive reuse module, we enhance primitive reusability by classifying inputs based on primitives replaced with the closest primitives from other classes. Experiments on three datasets validate our method, showing it outperforms current state-of-the-art methods with improved interpretability. Our code is available at https://github.com/Zoilsen/Comp-FSCIL.

📄 PDF Abstract BibTeX arXiv:2405.17022

Code (1)

zoilsen/comp-fscil 공식 구현 pytorch

Tasks

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
BASE 설명 없음

Similar Papers 제목 키워드 기반

Composition-Incremental Learning for Compositional Generalization

2025-11-12 · Zhen Li, Yuwei Wu, Chenchen Jing, Che Sun 외 arxiv

Compositional generalization has achieved substantial progress in computer vision on pre-collected training data. Nonetheless, real-world data continually emerges, with possible compositions being nearly infinite, long-t…

Compositional Zero-Shot LearningIncremental Learning

A Second-Order Perspective on Model Compositionality and Incremental Learning

2024-05-25 · Angelo Porrello, Lorenzo Bonicelli, Pietro Buzzega, Monica Millunzi 외

The fine-tuning of deep pre-trained models has revealed compositional properties, with multiple specialized modules that can be arbitrarily composed into a single, multi-task model. However, identifying the conditions th…

Incremental Learning

Anticipating Future Object Compositions without Forgetting

2024-07-15 · Youssef Zahran, Gertjan Burghouts, Yke Bauke Eisma

Despite the significant advancements in computer vision models, their ability to generalize to novel object-attribute compositions remains limited. Existing methods for Compositional Zero-Shot Learning (CZSL) mainly focu…

AttributeCompositional Zero-Shot Learningimage-classificationImage Classification+4

Not Just Object, But State: Compositional Incremental Learning without Forgetting

2024-11-04 · Yanyi Zhang, Binglin Qiu, Qi Jia, Yu Liu 외

Most incremental learners excessively prioritize coarse classes of objects while neglecting various kinds of states (e.g. color and material) attached to the objects. As a result, they are limited in the ability to reaso…

DiversityIncremental LearningObjectPrompt Learning

Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning

2022-05-09 · Na Dong, Yongqiang Zhang, Mingli Ding, Gim Hee Lee

Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on increme…

Few-Shot Object DetectionKnowledge DistillationObjectobject-detection+2