paper-with-me

Papers

XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot Learning

2020-03-19 · ICML 2020 1 · Sung Whan Yoon, Do-Yeon Kim, Jun Seo, Jaekyun Moon

Learning novel concepts while preserving prior knowledge is a long-standing challenge in machine learning. The challenge gets greater when a novel task is given with only a few labeled examples, a problem known as incremental few-shot learning. We propose XtarNet, which learns to extract task-adaptive representation (TAR) for facilitating incremental few-shot learning. The method utilizes a backbone network pretrained on a set of base categories while also employing additional modules that are meta-trained across episodes. Given a new task, the novel feature extracted from the meta-trained modules is mixed with the base feature obtained from the pretrained model. The process of combining two different features provides TAR and is also controlled by meta-trained modules. The TAR contains effective information for classifying both novel and base categories. The base and novel classifiers quickly adapt to a given task by utilizing the TAR. Experiments on standard image datasets indicate that XtarNet achieves state-of-the-art incremental few-shot learning performance. The concept of TAR can also be used in conjunction with existing incremental few-shot learning methods; extensive simulation results in fact show that applying TAR enhances the known methods significantly.

📄 PDF Abstract BibTeX arXiv:2003.08561

Code (1)

EdwinKim3069/XtarNet 공식 구현 tf

Tasks

Few-Shot LearningNovel ConceptsTAR

Similar Papers 제목 키워드 기반

SATHUR: Self Augmenting Task Hallucinal Unified Representation for Generalized Class Incremental Learning

2023-08-13 · Sathursan Kanagarajah, Thanuja Ambegoda, Ranga Rodrigo

Class Incremental Learning (CIL) is inspired by the human ability to learn new classes without forgetting previous ones. CIL becomes more challenging in real-world scenarios when the samples in each incremental step are …

class-incremental learningClass Incremental LearningIncremental Learning

DER: Dynamically Expandable Representation for Class Incremental Learning

2021-03-31 · CVPR 2021 1 · Shipeng Yan, Jiangwei Xie, Xuming He

We address the problem of class incremental learning, which is a core step towards achieving adaptive vision intelligence. In particular, we consider the task setting of incremental learning with limited memory and aim t…

class-incremental learningClass Incremental LearningIncremental LearningNovel Concepts

ALADE-SNN: Adaptive Logit Alignment in Dynamically Expandable Spiking Neural Networks for Class Incremental Learning

2024-12-17 · Wenyao Ni, Jiangrong Shen, Qi Xu, Huajin Tang

Inspired by the human brain's ability to adapt to new tasks without erasing prior knowledge, we develop spiking neural networks (SNNs) with dynamic structures for Class Incremental Learning (CIL). Our comparative experim…

class-incremental learningClass Incremental LearningContinual LearningIncremental Learning

Adaptive Online Incremental Learning for Evolving Data Streams

2022-01-05 · Si-si Zhang, Jian-wei Liu, Xin Zuo

Recent years have witnessed growing interests in online incremental learning. However, there are three major challenges in this area. The first major difficulty is concept drift, that is, the probability distribution in …

Incremental LearningRepresentation Learning

Decoupling Learning and Remembering: A Bilevel Memory Framework With Knowledge Projection for Task-Incremental Learning

2023-01-01 · CVPR 2023 1 · Wenju Sun, Qingyong Li, Jing Zhang, Wen Wang 외

The dilemma between plasticity and stability arises as a common challenge for incremental learning. In contrast, the human memory system is able to remedy this dilemma owing to its multi-level memory structure, which…

Incremental Learning