paper-with-me

홈 › Papers

DBIA: Data-free Backdoor Injection Attack against Transformer Networks

2021-11-22 · Peizhuo Lv, Hualong Ma, Jiachen Zhou, Ruigang Liang, Kai Chen, Shengzhi Zhang, Yunfei Yang

Recently, transformer architecture has demonstrated its significance in both Natural Language Processing (NLP) and Computer Vision (CV) tasks. Though other network models are known to be vulnerable to the backdoor attack, which embeds triggers in the model and controls the model behavior when the triggers are presented, little is known whether such an attack is still valid on the transformer models and if so, whether it can be done in a more cost-efficient manner. In this paper, we propose DBIA, a novel data-free backdoor attack against the CV-oriented transformer networks, leveraging the inherent attention mechanism of transformers to generate triggers and injecting the backdoor using the poisoned surrogate dataset. We conducted extensive experiments based on three benchmark transformers, i.e., ViT, DeiT and Swin Transformer, on two mainstream image classification tasks, i.e., CIFAR10 and ImageNet. The evaluation results demonstrate that, consuming fewer resources, our approach can embed backdoors with a high success rate and a low impact on the performance of the victim transformers. Our code is available at https://anonymous.4open.science/r/DBIA-825D.

📄 PDF Abstract BibTeX arXiv:2111.11870

Code (1)

yangyunfei16/DBIA pytorch

Tasks

Backdoor Attackimage-classificationImage Classificationvalid

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…

Similar Papers 제목 키워드 기반

A Proxy Attack-Free Strategy for Practically Improving the Poisoning Efficiency in Backdoor Attacks

2023-06-14 · Ziqiang Li, Hong Sun, Pengfei Xia, Beihao Xia 외

Poisoning efficiency is crucial in poisoning-based backdoor attacks, as attackers aim to minimize the number of poisoning samples while maximizing attack efficacy. Recent studies have sought to enhance poisoning efficien…

Active LearningBackdoor Attack

Pruning and Malicious Injection: A Retraining-Free Backdoor Attack on Transformer Models

2025-08-14 · Taibiao Zhao, Mingxuan Sun, Hao Wang, Xiaobing Chen 외 arxiv

Transformer models have demonstrated exceptional performance and have become indispensable in computer vision (CV) and natural language processing (NLP) tasks. However, recent studies reveal that transformers are suscept…

TooBadRL: Trigger Optimization to Boost Effectiveness of Backdoor Attacks on Deep Reinforcement Learning

2025-06-11 · Songze Li, Mingxuan Zhang, Kang Wei, Shouling Ji

Deep reinforcement learning (DRL) has achieved remarkable success in a wide range of sequential decision-making domains, including robotics, healthcare, smart grids, and finance. Recent research demonstrates that attacke…

Deep Reinforcement LearningSequential Decision Making

Injection, Attack and Erasure: Revocable Backdoor Attacks via Machine Unlearning

2025-10-15 · Baogang Song, Dongdong Zhao, Jianwen Xiang, Qiben Xu 외 arxiv

Backdoor attacks pose a persistent security risk to deep neural networks (DNNs) due to their stealth and durability. While recent research has explored leveraging model unlearning mechanisms to enhance backdoor concealme…

Bilevel Optimization

Don't Knock! Rowhammer at the Backdoor of DNN Models

2021-10-14 · M. Caner Tol, Saad Islam, Andrew J. Adiletta, Berk Sunar 외

State-of-the-art deep neural networks (DNNs) have been proven to be vulnerable to adversarial manipulation and backdoor attacks. Backdoored models deviate from expected behavior on inputs with predefined triggers while r…