12 mJ per Class On-Device Online Few-Shot Class-Incremental Learning
Few-Shot Class-Incremental Learning (FSCIL) enables machine learning systems to expand their inference capabilities to new classes using only a few labeled examples, without forgetting the previously learned classes. Classical backpropagation-based learning and its variants are often unsuitable for battery-powered, memory-constrained systems at the extreme edge. In this work, we introduce Online Few-Shot Class-Incremental Learning (O-FSCIL), based on a lightweight model consisting of a pretrained and metalearned feature extractor and an expandable explicit memory storing the class prototypes. The architecture is pretrained with a novel feature orthogonality regularization and metalearned with a multi-margin loss. For learning a new class, our approach extends the explicit memory with novel class prototypes, while the remaining architecture is kept frozen. This allows learning previously unseen classes based on only a few examples with one single pass (hence online). O-FSCIL obtains an average accuracy of 68.62% on the FSCIL CIFAR100 benchmark, achieving state-of-the-art results. Tailored for ultra-low-power platforms, we implement O-FSCIL on the 60 mW GAP9 microcontroller, demonstrating online learning capabilities within just 12 mJ per new class.
Code (1)
Tasks
class-incremental learningClass Incremental LearningContinual LearningFew-Shot Class-Incremental LearningImage ClassificationIncremental LearningSimilar Papers 제목 키워드 기반
Incremental Few-Shot Object Detection
Most existing object detection methods rely on the availability of abundant labelled training samples per class and offline model training in a batch mode. These requirements substantially limit their scalability to open…
Few-Shot LearningFew-Shot Object DetectionIncremental LearningMeta-Learning+3SAFA-SNN: Sparsity-Aware On-Device Few-Shot Class-Incremental Learning with Fast-Adaptive Structure of Spiking Neural Network
Continuous learning of novel classes is crucial for edge devices to preserve data privacy and maintain reliable performance in dynamic environments. However, the scenario becomes particularly challenging when data sample…
Few-Shot Class-Incremental LearningControllable Forgetting Mechanism for Few-Shot Class-Incremental Learning
Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challenge in these scenarios is balancing the t…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental LearningFSCIL-SEI: Few-Shot Class-Incremental Learning Approach for Specific Emitter Identification
—Specific emitter identification (SEI) is a non-password authentication method that adds an extra layer of security to wireless devices. However, existing SEI methods are unable to continuously learn new classes from …
class-incremental learningClass Incremental LearningContrastive LearningFew-Shot Class-Incremental Learning+1Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning
Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on increme…
Few-Shot Object DetectionKnowledge DistillationObjectobject-detection+2