paper-with-me

홈 › Papers

Continual Local Replacement for Few-shot Learning

2020-01-23 · Canyu Le, Zhonggui Chen, Xihan Wei, Biao Wang, Lei Zhang

The goal of few-shot learning is to learn a model that can recognize novel classes based on one or few training data. It is challenging mainly due to two aspects: (1) it lacks good feature representation of novel classes; (2) a few of labeled data could not accurately represent the true data distribution and thus it's hard to learn a good decision function for classification. In this work, we use a sophisticated network architecture to learn better feature representation and focus on the second issue. A novel continual local replacement strategy is proposed to address the data deficiency problem. It takes advantage of the content in unlabeled images to continually enhance labeled ones. Specifically, a pseudo labeling method is adopted to constantly select semantically similar images on the fly. Original labeled images will be locally replaced by the selected images for the next epoch training. In this way, the model can directly learn new semantic information from unlabeled images and the capacity of supervised signals in the embedding space can be significantly enlarged. This allows the model to improve generalization and learn a better decision boundary for classification. Our method is conceptually simple and easy to implement. Extensive experiments demonstrate that it can achieve state-of-the-art results on various few-shot image recognition benchmarks.

📄 PDF Abstract BibTeX arXiv:2001.08366

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningGeneral Classification

Similar Papers 제목 키워드 기반

Better Rates for Random Task Orderings in Continual Linear Models

2025-04-06 · Itay Evron, Ran Levinstein, Matan Schliserman, Uri Sherman 외

We study the common continual learning setup where an overparameterized model is sequentially fitted to a set of jointly realizable tasks. We analyze the forgetting, i.e., loss on previously seen tasks, after $k$ iterati…

Continual Learning

Optimal Importance Sampling for Federated Learning

2020-10-26 · Elsa Rizk, Stefan Vlaski, Ali H. Sayed

Federated learning involves a mixture of centralized and decentralized processing tasks, where a server regularly selects a sample of the agents and these in turn sample their local data to compute stochastic gradients f…

Federated Learningregression

Continual Normalization: Rethinking Batch Normalization for Online Continual Learning

2022-03-30 · ICLR 2022 4 · Quang Pham, Chenghao Liu, Steven Hoi

Existing continual learning methods use Batch Normalization (BN) to facilitate training and improve generalization across tasks. However, the non-i.i.d and non-stationary nature of continual learning data, especially in …

Continual Learning

Few-shot Continual Infomax Learning

2023-01-01 · ICCV 2023 1 · Ziqi Gu, Chunyan Xu, Jian Yang, Zhen Cui

Few-shot continual learning is the ability to continually train a neural network from a sequential stream of few-shot data. In this paper, we propose a Few-shot Continual Infomax Learning (FCIL) framework that makes …

Continual LearningFew-Shot Learning

Dynamic VAEs with Generative Replay for Continual Zero-shot Learning

2021-04-26 · Subhankar Ghosh

Continual zero-shot learning(CZSL) is a new domain to classify objects sequentially the model has not seen during training. It is more suitable than zero-shot and continual learning approaches in real-case scenarios when…

Continual LearningZero-Shot Learning