paper-with-me

홈 › Papers

Yet Meta Learning Can Adapt Fast, It Can Also Break Easily

2020-09-02 · Han Xu, Ya-Xin Li, Xiaorui Liu, Hui Liu, Jiliang Tang

Meta learning algorithms have been widely applied in many tasks for efficient learning, such as few-shot image classification and fast reinforcement learning. During meta training, the meta learner develops a common learning strategy, or experience, from a variety of learning tasks. Therefore, during meta test, the meta learner can use the learned strategy to quickly adapt to new tasks even with a few training samples. However, there is still a dark side about meta learning in terms of reliability and robustness. In particular, is meta learning vulnerable to adversarial attacks? In other words, would a well-trained meta learner utilize its learned experience to build wrong or likely useless knowledge, if an adversary unnoticeably manipulates the given training set? Without the understanding of this problem, it is extremely risky to apply meta learning in safety-critical applications. Thus, in this paper, we perform the initial study about adversarial attacks on meta learning under the few-shot classification problem. In particular, we formally define key elements of adversarial attacks unique to meta learning and propose the first attacking algorithm against meta learning under various settings. We evaluate the effectiveness of the proposed attacking strategy as well as the robustness of several representative meta learning algorithms. Experimental results demonstrate that the proposed attacking strategy can easily break the meta learner and meta learning is vulnerable to adversarial attacks. The implementation of the proposed framework will be released upon the acceptance of this paper.

📄 PDF Abstract BibTeX arXiv:2009.01672

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Image Classificationimage-classificationImage ClassificationMeta-Learning

Similar Papers 제목 키워드 기반

On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning

2021-02-20 · ICLR 2021 1 · Ren Wang, Kaidi Xu, Sijia Liu, Pin-Yu Chen 외

Model-agnostic meta-learning (MAML) has emerged as one of the most successful meta-learning techniques in few-shot learning. It enables us to learn a meta-initialization} of model parameters (that we call meta-model) to …

Adversarial AttackAdversarial RobustnessContrastive LearningData Augmentation+2

Fast and Effective Adaptation of Facial Action Unit Detection Deep Model

2019-09-26 · Mihee Lee, Ognjen Rudovic, Vladimir Pavlovic, Maja Pantic

Detecting facial action units (AU) is one of the fundamental steps in automatic recognition of facial expression of emotions and cognitive states. Though there have been a variety of approaches proposed for this task, mo…

Action Unit DetectionFacial Action Unit DetectionMeta-Learning

Meta-SGD: Learning to Learn Quickly for Few-Shot Learning

2017-07-31 · Zhenguo Li, Fengwei Zhou, Fei Chen, Hang Li

Few-shot learning is challenging for learning algorithms that learn each task in isolation and from scratch. In contrast, meta-learning learns from many related tasks a meta-learner that can learn a new task more accurat…

Few-Shot LearningMeta-Learningreinforcement-learningReinforcement Learning+1

Semi-supervised on-device neural network adaptation for remote and portable laser-induced breakdown spectroscopy

2021-04-08 · Kshitij Bhardwaj, Maya Gokhale

Laser-induced breakdown spectroscopy (LIBS) is a popular, fast elemental analysis technique used to determine the chemical composition of target samples, such as in industrial analysis of metals or in space exploration. …

Meta-Learning Fast Weight Language Models

2022-12-05 · Kevin Clark, Kelvin Guu, Ming-Wei Chang, Panupong Pasupat 외

Dynamic evaluation of language models (LMs) adapts model parameters at test time using gradient information from previous tokens and substantially improves LM performance. However, it requires over 3x more compute than s…

Language ModelingLanguage ModellingMeta-Learning