Representation Change in Model-Agnostic Meta-Learning
Last year, an exciting adaptation of one of the most popular optimization-based meta-learning approaches, model-agnostic meta-learning (MAML) [Finn et al., 2017], was proposed in - Jaehoon Oh, Hyungjun Yoo, ChangHwan Kim, Se-Young Yun (ICLR, 2021) BOIL: Towards Representation Change for Few-shot Learning The authors adapt MAML by freezing the last layer to force body only inner learning (BOIL). Interestingly, this is complementary to ANIL (almost no inner loop) proposed in - Aniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol Vinyals (ICLR, 2020) Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Both papers attempt to understand the success of MAML and improve it. Oh et al. [2021] compare BOIL, ANIL, and MAML and show that both improve the performance of MAML, but BOIL outperforms ANIL, especially when the task distribution varies between training and testing.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningMeta-LearningmodelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BOIL: Towards Representation Change for Few-shot Learning
Model Agnostic Meta-Learning (MAML) is one of the most representative of gradient-based meta-learning algorithms. MAML learns new tasks with a few data samples using inner updates from a meta-initialization point and lea…
Few-Shot LearningMeta-LearningExploring the Similarity of Representations in Model-Agnostic Meta-Learning
In past years model-agnostic meta-learning (MAML) has been one of the most promising approaches in meta-learning. It can be applied to different kinds of problems, e.g., reinforcement learning, but also shows good result…
Few-Shot LearningMeta-LearningDisenGCD: A Meta Multigraph-assisted Disentangled Graph Learning Framework for Cognitive Diagnosis
Existing graph learning-based cognitive diagnosis (CD) methods have made relatively good results, but their student, exercise, and concept representations are learned and exchanged in an implicit unified graph, which mak…
cognitive diagnosisDiagnosticGraph AttentionGraph LearningOn the Importance of Attention in Meta-Learning for Few-Shot Text Classification
Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure t…
ClassificationFew-Shot Text ClassificationGeneral ClassificationInductive Bias+7MetaFAP: Meta-Learning for Frequency Agnostic Prediction of Metasurface Properties
Metasurfaces, and in particular reconfigurable intelligent surfaces (RIS), are revolutionizing wireless communications by dynamically controlling electromagnetic waves. Recent wireless communication advancements necessit…
Meta-LearningProperty Prediction