paper-with-me

홈 › Papers

Universal Adversarial Triggers

2026-05-18 · Benedict Florance Arockiaraj, Alexander Feng, Jianxiong Cai, Xiaoyu Cheng arxiv

Recent works have illustrated that modern NLP models trained for diverse tasks ranging from sentiment analysis to language generation succumb to universal adversarial attacks, a class of input-agnostic attacks where a common trigger sequence is used to attack the model. Although these attacks are successful, the triggers generated by such attacks are ungrammatical and unnatural. Our work proposes a novel technique combining parts-of-speech filtering and perplexity based loss function to generate sensible triggers that are closer to natural phrases. For the task of sentiment analysis on the SST dataset, the method produces sensible triggers that achieve accuracies as low as 0.04 and 0.12 for flipping positive to negative predictions and vice-versa. To build robust models, we also perform adversarial training using the generated triggers that increases the accuracy of the model from 0.12 to 0.48. We aim to illustrate that adversarial attacks can be made difficult to detect by generating sensible triggers, and to facilitate robust model development through relevant defenses.

📄 PDF Abstract BibTeX arXiv:2605.17936

Code (0)

등록된 구현이 없습니다.

Tasks

Sentiment Analysis

Similar Papers 제목 키워드 기반

MINIMAL: Mining Models for Data Free Universal Adversarial Triggers

2021-09-25 · Swapnil Parekh, Yaman Singla Kumar, Somesh Singh, Changyou Chen 외

It is well known that natural language models are vulnerable to adversarial attacks, which are mostly input-specific in nature. Recently, it has been shown that there also exist input-agnostic attacks in NLP models, call…

Natural Language Inference

Universal Adversarial Triggers Are Not Universal

2024-04-24 · Nicholas Meade, Arkil Patel, Siva Reddy

Recent work has developed optimization procedures to find token sequences, called adversarial triggers, which can elicit unsafe responses from aligned language models. These triggers are believed to be universally transf…

Exploring the Universal Vulnerability of Prompt-based Learning Paradigm

2022-04-11 · Findings (NAACL) 2022 7 · Lei Xu, Yangyi Chen, Ganqu Cui, Hongcheng Gao 외

Prompt-based learning paradigm bridges the gap between pre-training and fine-tuning, and works effectively under the few-shot setting. However, we find that this learning paradigm inherits the vulnerability from the pre-…

Exploring the Universal Vulnerability of Prompt-based Learning Paradigm

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Prompt-based learning paradigm bridges the gap between pre-training and fine-tuning, and works effectively under the few-shot setting. However, we find that this learning paradigm inherits the vulnerability from the pre-…

Attack on Unfair ToS Clause Detection: A Case Study using Universal Adversarial Triggers

2022-11-28 · Shanshan Xu, Irina Broda, Rashid Haddad, Marco Negrini 외

Recent work has demonstrated that natural language processing techniques can support consumer protection by automatically detecting unfair clauses in the Terms of Service (ToS) Agreement. This work demonstrates that tran…