paper-with-me

Papers

Backdoor Attacks against Transfer Learning with Pre-trained Deep Learning Models

2020-01-10 · Shuo Wang, Surya Nepal, Carsten Rudolph, Marthie Grobler, Shangyu Chen, Tianle Chen

Transfer learning provides an effective solution for feasibly and fast customize accurate \textit{Student} models, by transferring the learned knowledge of pre-trained \textit{Teacher} models over large datasets via fine-tuning. Many pre-trained Teacher models used in transfer learning are publicly available and maintained by public platforms, increasing their vulnerability to backdoor attacks. In this paper, we demonstrate a backdoor threat to transfer learning tasks on both image and time-series data leveraging the knowledge of publicly accessible Teacher models, aimed at defeating three commonly-adopted defenses: \textit{pruning-based}, \textit{retraining-based} and \textit{input pre-processing-based defenses}. Specifically, (A) ranking-based selection mechanism to speed up the backdoor trigger generation and perturbation process while defeating \textit{pruning-based} and/or \textit{retraining-based defenses}. (B) autoencoder-powered trigger generation is proposed to produce a robust trigger that can defeat the \textit{input pre-processing-based defense}, while guaranteeing that selected neuron(s) can be significantly activated. (C) defense-aware retraining to generate the manipulated model using reverse-engineered model inputs. We launch effective misclassification attacks on Student models over real-world images, brain Magnetic Resonance Imaging (MRI) data and Electrocardiography (ECG) learning systems. The experiments reveal that our enhanced attack can maintain the $98.4\%$ and $97.2\%$ classification accuracy as the genuine model on clean image and time series inputs respectively while improving $27.9\%-100\%$ and $27.1\%-56.1\%$ attack success rate on trojaned image and time series inputs respectively in the presence of pruning-based and/or retraining-based defenses.

📄 PDF Abstract BibTeX arXiv:2001.03274

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningElectrocardiography (ECG)Electroencephalogram (EEG)Time SeriesTime Series AnalysisTransfer Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Models

2023-05-28 · Kai Mei, Zheng Li, Zhenting Wang, Yang Zhang 외

Prompt-based learning is vulnerable to backdoor attacks. Existing backdoor attacks against prompt-based models consider injecting backdoors into the entire embedding layers or word embedding vectors. Such attacks can be …

BadPre: Task-agnostic Backdoor Attacks to Pre-trained NLP Foundation Models

2021-10-06 · ICLR 2022 4 · Kangjie Chen, Yuxian Meng, Xiaofei Sun, Shangwei Guo 외

Pre-trained Natural Language Processing (NLP) models can be easily adapted to a variety of downstream language tasks. This significantly accelerates the development of language models. However, NLP models have been shown…

Backdoor AttackTransfer Learning

Cross-Context Backdoor Attacks against Graph Prompt Learning

2024-05-28 · Xiaoting Lyu, Yufei Han, Wei Wang, Hangwei Qian 외

Graph Prompt Learning (GPL) bridges significant disparities between pretraining and downstream applications to alleviate the knowledge transfer bottleneck in real-world graph learning. While GPL offers superior effective…

Backdoor AttackComputational EfficiencyGraph ClassificationGraph Learning+2

Regula Sub-rosa: Latent Backdoor Attacks on Deep Neural Networks

2019-05-24 · Yuanshun Yao, Huiying Li, Hai-Tao Zheng, Ben Y. Zhao

Recent work has proposed the concept of backdoor attacks on deep neural networks (DNNs), where misbehaviors are hidden inside "normal" models, only to be triggered by very specific inputs. In practice, however, these att…

Backdoor AttackTraffic Sign RecognitionTransfer Learning

TuBA: Cross-Lingual Transferability of Backdoor Attacks in LLMs with Instruction Tuning

2024-04-30 · Xuanli He, Jun Wang, Qiongkai Xu, Pasquale Minervini 외

The implications of backdoor attacks on English-centric large language models (LLMs) have been widely examined - such attacks can be achieved by embedding malicious behaviors during training and activated under specific …