paper-with-me

Papers

Unlocking Compositional Generalization in Continual Few-Shot Learning

2026-05-12 · Phu-Quy Nguyen-Lam, Phu-Hoa Pham, Dao Sy Duy Minh, Chi-Nguyen Tran, Huynh Trung Kiet, Long Tran-Thanh arxiv

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different concepts. In practice, this potential is rarely realized. Continual learners either collapse scenes into global embeddings, or train with part-level matching objectives that tie representations too closely to seen patterns, leaving them unable to generalize to truly novel concepts. In this paper, we identify this fundamental structural conflict and pioneer a new paradigm that strictly decouples representation learning from compositional inference. Leveraging the inherent patch-level semantic geometry of self-supervised Vision Transformers (ViTs), our framework employs a dual-phase strategy. During training, slot representations are optimized entirely toward holistic class identity, preserving highly generalizable, object-level geometries. At inference, preserved slots are dynamically composed to match novel scenes. We demonstrate that this paradigm offers dual structural benefits: The frozen backbone naturally prevents representation drift, while our lightweight, holistic optimization preserves the features' capacity for novel-concept transfer. Extensive experiments validate this approach, achieving state-of-the-art unseen-concept generalization and minimal forgetting across standard continual learning benchmarks.

📄 PDF Abstract BibTeX arXiv:2605.11710

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningContinual LearningFew-Shot Learning

Similar Papers 제목 키워드 기반

Does Continual Learning Meet Compositionality? New Benchmarks and An Evaluation Framework

2023-09-26 · NeurIPS 2023 11

Compositionality facilitates the comprehension of novel objects using acquired concepts and the maintenance of a knowledge pool. This is particularly crucial for continual learners to prevent catastrophic forgetting and …

Composition-Incremental Learning for Compositional Generalization

2025-11-12 · Zhen Li, Yuwei Wu, Chenchen Jing, Che Sun 외 arxiv

Compositional generalization has achieved substantial progress in computer vision on pre-collected training data. Nonetheless, real-world data continually emerges, with possible compositions being nearly infinite, long-t…

Compositional Zero-Shot LearningIncremental Learning

Prompt-Based Continual Compositional Zero-Shot Learning

2025-12-09 · Sauda Maryam, Sara Nadeem, Faisal Qureshi, Mohsen Ali arxiv

We tackle continual adaptation of vision-language models to new attributes, objects, and their compositions in Compositional Zero-Shot Learning (CZSL), while preventing forgetting of prior knowledge. Unlike classical con…

Compositional Zero-Shot LearningContinual Learning

Exploring Continual Learning of Compositional Generalization in NLI

2024-03-07 · Xiyan Fu, Anette Frank

Compositional Natural Language Inference has been explored to assess the true abilities of neural models to perform NLI. Yet, current evaluations assume models to have full access to all primitive inferences in advance, …

Continual LearningNatural Language Inference

Skills-in-Context Prompting: Unlocking Compositionality in Large Language Models

2023-08-01 · Jiaao Chen, Xiaoman Pan, Dian Yu, Kaiqiang Song 외

We investigate how to elicit compositional generalization capabilities in large language models (LLMs). Compositional generalization empowers LLMs to solve complex problems by combining foundational skills, a critical re…

In-Context LearningMathMathematical ReasoningMath Word Problem Solving+1