Few-Shot Class-Incremental Learning with Non-IID Decentralized Data
Few-shot class-incremental learning is crucial for developing scalable and adaptive intelligent systems, as it enables models to acquire new classes with minimal annotated data while safeguarding the previously accumulated knowledge. Nonetheless, existing methods deal with continuous data streams in a centralized manner, limiting their applicability in scenarios that prioritize data privacy and security. To this end, this paper introduces federated few-shot class-incremental learning, a decentralized machine learning paradigm tailored to progressively learn new classes from scarce data distributed across multiple clients. In this learning paradigm, clients locally update their models with new classes while preserving data privacy, and then transmit the model updates to a central server where they are aggregated globally. However, this paradigm faces several issues, such as difficulties in few-shot learning, catastrophic forgetting, and data heterogeneity. To address these challenges, we present a synthetic data-driven framework that leverages replay buffer data to maintain existing knowledge and facilitate the acquisition of new knowledge. Within this framework, a noise-aware generative replay module is developed to fine-tune local models with a balance of new and replay data, while generating synthetic data of new classes to further expand the replay buffer for future tasks. Furthermore, a class-specific weighted aggregation strategy is designed to tackle data heterogeneity by adaptively aggregating class-specific parameters based on local models performance on synthetic data. This enables effective global model optimization without direct access to client data. Comprehensive experiments across three widely-used datasets underscore the effectiveness and preeminence of the introduced framework.
Code (0)
등록된 구현이 없습니다.
Tasks
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningFew-Shot LearningIncremental LearningModel OptimizationSimilar Papers 제목 키워드 기반
Deep Class Incremental Learning from Decentralized Data
In this paper, we focus on a new and challenging decentralized machine learning paradigm in which there are continuous inflows of data to be addressed and the data are stored in multiple repositories. We initiate the stu…
class-incremental learningClass Incremental LearningIncremental LearningKnowledge DistillationIncremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning
Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on increme…
Few-Shot Object DetectionKnowledge DistillationObjectobject-detection+2Few-Shot Batch Incremental Road Object Detection via Detector Fusion
Incremental few-shot learning has emerged as a new and challenging area in deep learning, whose objective is to train deep learning models using very few samples of new class data, and none of the old class data. In this…
Few-Shot Learningobject-detectionObject DetectionFew-shot Class-incremental Learning for Classification and Object Detection: A Survey
Few-shot Class-Incremental Learning (FSCIL) presents a unique challenge in Machine Learning (ML), as it necessitates the Incremental Learning (IL) of new classes from sparsely labeled training samples without forgetting …
class-incremental learningClass Incremental LearningClass-Incremental Object DetectionFew-Shot Class-Incremental Learning+5Cognitively-Inspired Model for Incremental Learning Using a Few Examples
Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes …
class-incremental learningClass Incremental LearningGeneral ClassificationHippocampus+1