paper-with-me

홈 › Papers

BI-MAML: Balanced Incremental Approach for Meta Learning

2020-06-12 · Yang Zheng, Jinlin Xiang, Kun Su, Eli Shlizerman

We present a novel Balanced Incremental Model Agnostic Meta Learning system (BI-MAML) for learning multiple tasks. Our method implements a meta-update rule to incrementally adapt its model to new tasks without forgetting old tasks. Such a capability is not possible in current state-of-the-art MAML approaches. These methods effectively adapt to new tasks, however, suffer from 'catastrophic forgetting' phenomena, in which new tasks that are streamed into the model degrade the performance of the model on previously learned tasks. Our system performs the meta-updates with only a few-shots and can successfully accomplish them. Our key idea for achieving this is the design of balanced learning strategy for the baseline model. The strategy sets the baseline model to perform equally well on various tasks and incorporates time efficiency. The balanced learning strategy enables BI-MAML to both outperform other state-of-the-art models in terms of classification accuracy for existing tasks and also accomplish efficient adaption to similar new tasks with less required shots. We evaluate BI-MAML by conducting comparisons on two common benchmark datasets with multiple number of image classification tasks. BI-MAML performance demonstrates advantages in both accuracy and efficiency.

📄 PDF Abstract BibTeX arXiv:2006.07412

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationimage-classificationImage ClassificationMeta-Learning

Methods 이 논문이 사용한 방법론

MAML 설명 없음

Similar Papers 제목 키워드 기반

Is Bayesian Model-Agnostic Meta Learning Better than Model-Agnostic Meta Learning, Provably?

2022-03-06 · Lisha Chen, Tianyi Chen

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modelin…

Meta-Learningmodel

Sign-MAML: Efficient Model-Agnostic Meta-Learning by SignSGD

2021-09-15 · Chen Fan, Parikshit Ram, Sijia Liu

We propose a new computationally-efficient first-order algorithm for Model-Agnostic Meta-Learning (MAML). The key enabling technique is to interpret MAML as a bilevel optimization (BLO) problem and leverage the sign-base…

Bilevel OptimizationFew-Shot Image Classificationimage-classificationImage Classification+1

Directed-MAML: Meta Reinforcement Learning Algorithm with Task-directed Approximation

2025-09-30 · Yang Zhang, Huiwen Yan, Mushuang Liu arxiv

Model-Agnostic Meta-Learning (MAML) is a versatile meta-learning framework applicable to both supervised learning and reinforcement learning (RL). However, applying MAML to meta-reinforcement learning (meta-RL) presents …

Computational EfficiencyReinforcement Learning

Meta-Learning for Federated Face Recognition in Imbalanced Data Regimes

2024-08-13 · Arwin Gansekoele, Emiel Hess, Sandjai Bhulai

The growing privacy concerns surrounding face image data demand new techniques that can guarantee user privacy. One such face recognition technique that claims to achieve better user privacy is Federated Face Recognition…

Face RecognitionFairnessFederated LearningMeta-Learning

How to Train Your MAML to Excel in Few-Shot Classification

2021-06-30 · ICLR 2022 4 · Han-Jia Ye, Wei-Lun Chao

Model-agnostic meta-learning (MAML) is arguably one of the most popular meta-learning algorithms nowadays. Nevertheless, its performance on few-shot classification is far behind many recent algorithms dedicated to the pr…

ClassificationMeta-Learning