Active Class Selection for Few-Shot Class-Incremental Learning

2023-07-05 · Christopher McClurg, Ali Ayub, Harsh Tyagi, Sarah M. Rajtmajer, Alan R. Wagner

For real-world applications, robots will need to continually learn in their environments through limited interactions with their users. Toward this, previous works in few-shot class incremental learning (FSCIL) and active class selection (ACS) have achieved promising results but were tested in constrained setups. Therefore, in this paper, we combine ideas from FSCIL and ACS to develop a novel framework that can allow an autonomous agent to continually learn new objects by asking its users to label only a few of the most informative objects in the environment. To this end, we build on a state-of-the-art (SOTA) FSCIL model and extend it with techniques from ACS literature. We term this model Few-shot Incremental Active class SeleCtiOn (FIASco). We further integrate a potential field-based navigation technique with our model to develop a complete framework that can allow an agent to process and reason on its sensory data through the FIASco model, navigate towards the most informative object in the environment, gather data about the object through its sensors and incrementally update the FIASco model. Experimental results on a simulated agent and a real robot show the significance of our approach for long-term real-world robotics applications.

📄 PDF Abstract BibTeX arXiv:2307.02641

Code (1)

chrismcclurg/fscil-acs 공식 구현

Tasks

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental LearningNavigate

Class Balance Matters to Active Class-Incremental Learning

2024-12-09 · Zitong Huang, Ze Chen, Yuanze Li, Bowen Dong 외

Few-Shot Class-Incremental Learning has shown remarkable efficacy in efficient learning new concepts with limited annotations. Nevertheless, the heuristic few-shot annotations may not always cover the most informative sa…

Active Learning class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning+2

Few-shot Class-incremental Learning for Classification and Object Detection: A Survey

2023-08-13 · Jinghua Zhang, Li Liu, Olli Silvén, Matti Pietikäinen 외

Few-shot Class-Incremental Learning (FSCIL) presents a unique challenge in Machine Learning (ML), as it necessitates the Incremental Learning (IL) of new classes from sparsely labeled training samples without forgetting …

class-incremental learning Class Incremental Learning Class-Incremental Object Detection Few-Shot Class-Incremental Learning+5

Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learning

2021-07-19 · CVPR 2021 1 · Kai Zhu, Yang Cao, Wei Zhai, Jie Cheng 외

Few-shot class-incremental learning is to recognize the new classes given few samples and not forget the old classes. It is a challenging task since representation optimization and prototype reorganization can only be ac…

class-incremental learning Class Incremental Learning Few-Shot Class-Incremental Learning Incremental Learning+1

IFSENet : Harnessing Sparse Iterations for Interactive Few-shot Segmentation Excellence

2024-03-22 · Shreyas Chandgothia, Ardhendu Sekhar, Amit Sethi

Training a computer vision system to segment a novel class typically requires collecting and painstakingly annotating lots of images with objects from that class. Few-shot segmentation techniques reduce the required numb…

Interactive Segmentation Segmentation

UIFormer: A Unified Transformer-based Framework for Incremental Few-Shot Object Detection and Instance Segmentation

2024-11-13 · ChengYuan Zhang, Yilin Zhang, Lei Zhu, Deyin Liu 외

This paper introduces a novel framework for unified incremental few-shot object detection (iFSOD) and instance segmentation (iFSIS) using the Transformer architecture. Our goal is to create an optimal solution for situat…

Decoder Few-Shot Object Detection Incremental Learning Instance Segmentation+4