Few-Shot Continual Active Learning by a Robot
In this paper, we consider a challenging but realistic continual learning (CL) problem, Few-Shot Continual Active Learning (FoCAL), where a CL agent is provided with unlabeled data for a new or a previously learned task in each increment and the agent only has limited labeling budget available. Towards this, we build on the continual learning and active learning literature and develop a framework that can allow a CL agent to continually learn new object classes from a few labeled training examples. Our framework represents each object class using a uniform Gaussian mixture model (GMM) and uses pseudo-rehearsal to mitigate catastrophic forgetting. The framework also uses uncertainty measures on the Gaussian representations of the previously learned classes to find the most informative samples to be labeled in an increment. We evaluate our approach on the CORe-50 dataset and on a real humanoid robot for the object classification task. The results show that our approach not only produces state-of-the-art results on the dataset but also allows a real robot to continually learn unseen objects in a real environment with limited labeling supervision provided by its user.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningContinual LearningObjectSimilar Papers 제목 키워드 기반
Active Class Selection for Few-Shot Class-Incremental Learning
For real-world applications, robots will need to continually learn in their environments through limited interactions with their users. Toward this, previous works in few-shot class incremental learning (FSCIL) and activ…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning+1Continual Skill and Task Learning via Dialogue
Continual and interactive robot learning is a challenging problem as the robot is present with human users who expect the robot to learn novel skills to solve novel tasks perpetually with sample efficiency. In this work …
Continual LearningInstruction FollowingInteractive Continual Learning Architecture for Long-Term Personalization of Home Service Robots
For robots to perform assistive tasks in unstructured home environments, they must learn and reason on the semantic knowledge of the environments. Despite a resurgence in the development of semantic reasoning architectur…
Continual LearningInteractive Visual Task Learning for Robots
We present a framework for robots to learn novel visual concepts and tasks via in-situ linguistic interactions with human users. Previous approaches have either used large pre-trained visual models to infer novel objects…
Continual LearningNovel ConceptsQuestion AnsweringVisual Question Answering+1PACT: Proactive Asking for Continual Task Assistance in Human-Robot Collaboration
Robotic assistants in long-term human-robot collaboration need to assist users under partial observations while leveraging cross-day interaction history. However, human traits and routines are often unknown at the beginn…
Reinforcement Learning