paper-with-me

Papers

Imperio: Language-Guided Backdoor Attacks for Arbitrary Model Control

2024-01-02 · Ka-Ho Chow, Wenqi Wei, Lei Yu

Natural language processing (NLP) has received unprecedented attention. While advancements in NLP models have led to extensive research into their backdoor vulnerabilities, the potential for these advancements to introduce new backdoor threats remains unexplored. This paper proposes Imperio, which harnesses the language understanding capabilities of NLP models to enrich backdoor attacks. Imperio provides a new model control experience. Demonstrated through controlling image classifiers, it empowers the adversary to manipulate the victim model with arbitrary output through language-guided instructions. This is achieved using a language model to fuel a conditional trigger generator, with optimizations designed to extend its language understanding capabilities to backdoor instruction interpretation and execution. Our experiments across three datasets, five attacks, and nine defenses confirm Imperio's effectiveness. It can produce contextually adaptive triggers from text descriptions and control the victim model with desired outputs, even in scenarios not encountered during training. The attack reaches a high success rate across complex datasets without compromising the accuracy of clean inputs and exhibits resilience against representative defenses.

📄 PDF Abstract BibTeX arXiv:2401.01085

Code (0)

등록된 구현이 없습니다.

Tasks

Backdoor AttackImage ClassificationLanguage ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

Claim-Guided Textual Backdoor Attack for Practical Applications

2024-09-25 · Minkyoo Song, Hanna Kim, Jaehan Kim, Youngjin Jin 외

Recent advances in natural language processing and the increased use of large language models have exposed new security vulnerabilities, such as backdoor attacks. Previous backdoor attacks require input manipulation afte…

Backdoor Attack

MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statistic

2022-05-13 · Hang Wang, Zhen Xiang, David J. Miller, George Kesidis

Backdoor attacks are an important type of adversarial threat against deep neural network classifiers, wherein test samples from one or more source classes will be (mis)classified to the attacker's target class when a bac…

Adversarial AttackBackdoor Attackbackdoor defenseVocal Bursts Type Prediction

Marksman Backdoor: Backdoor Attacks with Arbitrary Target Class

2022-10-17 · Khoa D. Doan, Yingjie Lao, Ping Li

In recent years, machine learning models have been shown to be vulnerable to backdoor attacks. Under such attacks, an adversary embeds a stealthy backdoor into the trained model such that the compromised models will beha…

Backdoor Attack

InverTune: Removing Backdoors from Multimodal Contrastive Learning Models via Trigger Inversion and Activation Tuning

2025-06-14 · Mengyuan Sun, Yu Li, Yuchen Liu, Bo Du 외

Multimodal contrastive learning models like CLIP have demonstrated remarkable vision-language alignment capabilities, yet their vulnerability to backdoor attacks poses critical security risks. Attackers can implant laten…

backdoor defenseContrastive Learning

Label-Consistent Backdoor Attacks

2019-12-05 · Alexander Turner, Dimitris Tsipras, Aleksander Madry

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoo…