paper-with-me

홈 › Papers

Does Few-shot Learning Suffer from Backdoor Attacks?

2023-12-31 · Xinwei Liu, Xiaojun Jia, Jindong Gu, Yuan Xun, Siyuan Liang, Xiaochun Cao

The field of few-shot learning (FSL) has shown promising results in scenarios where training data is limited, but its vulnerability to backdoor attacks remains largely unexplored. We first explore this topic by first evaluating the performance of the existing backdoor attack methods on few-shot learning scenarios. Unlike in standard supervised learning, existing backdoor attack methods failed to perform an effective attack in FSL due to two main issues. Firstly, the model tends to overfit to either benign features or trigger features, causing a tough trade-off between attack success rate and benign accuracy. Secondly, due to the small number of training samples, the dirty label or visible trigger in the support set can be easily detected by victims, which reduces the stealthiness of attacks. It seemed that FSL could survive from backdoor attacks. However, in this paper, we propose the Few-shot Learning Backdoor Attack (FLBA) to show that FSL can still be vulnerable to backdoor attacks. Specifically, we first generate a trigger to maximize the gap between poisoned and benign features. It enables the model to learn both benign and trigger features, which solves the problem of overfitting. To make it more stealthy, we hide the trigger by optimizing two types of imperceptible perturbation, namely attractive and repulsive perturbation, instead of attaching the trigger directly. Once we obtain the perturbations, we can poison all samples in the benign support set into a hidden poisoned support set and fine-tune the model on it. Our method demonstrates a high Attack Success Rate (ASR) in FSL tasks with different few-shot learning paradigms while preserving clean accuracy and maintaining stealthiness. This study reveals that few-shot learning still suffers from backdoor attacks, and its security should be given attention.

📄 PDF Abstract BibTeX arXiv:2401.01377

Code (0)

등록된 구현이 없습니다.

Tasks

Backdoor AttackFew-Shot Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models

2023-05-02 · Shuai Zhao, Jinming Wen, Luu Anh Tuan, Junbo Zhao 외

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied,…

Backdoor AttackFew-Shot Text Classificationtext-classificationText Classification

A Survey of Recent Backdoor Attacks and Defenses in Large Language Models

2024-06-10 · Shuai Zhao, Meihuizi Jia, Zhongliang Guo, Leilei Gan 외

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot setti…

parameter-efficient fine-tuning

CLIBE: Detecting Dynamic Backdoors in Transformer-based NLP Models

2024-09-02 · Rui Zeng, Xi Chen, Yuwen Pu, Xuhong Zhang 외

Backdoors can be injected into NLP models to induce misbehavior when the input text contains a specific feature, known as a trigger, which the attacker secretly selects. Unlike fixed words, phrases, or sentences used in …

Text ClassificationText Generation

Imperceptible and Multi-channel Backdoor Attack against Deep Neural Networks

2022-01-31 · Mingfu Xue, Shifeng Ni, Yinghao Wu, Yushu Zhang 외

Recent researches demonstrate that Deep Neural Networks (DNN) models are vulnerable to backdoor attacks. The backdoored DNN model will behave maliciously when images containing backdoor triggers arrive. To date, existing…

Backdoor Attackbackdoor defense

Provable one-poison backdoor attacks on linear models and ReLU neural networks

2025-08-07 · Thorsten Peinemann, Paula Arnold, Sebastian Berndt, Thomas Eisenbarth 외 arxiv

Backdoor poisoning attacks are a threat to machine learning models that are trained on data collected from untrusted sources; these attacks enable attackers to inject malicious behavior into the model that can be trigger…