Mischief: A Simple Black-Box Attack Against Transformer Architectures
We introduce Mischief, a simple and lightweight method to produce a class of human-readable, realistic adversarial examples for language models. We perform exhaustive experimentations of our algorithm on four transformer-based architectures, across a variety of downstream tasks, as well as under varying concentrations of said examples. Our findings show that the presence of Mischief-generated adversarial samples in the test set significantly degrades (by up to $20\%$) the performance of these models with respect to their reported baselines. Nonetheless, we also demonstrate that, by including similar examples in the training set, it is possible to restore the baseline scores on the adversarial test set. Moreover, for certain tasks, the models trained with Mischief set show a modest increase on performance with respect to their original, non-adversarial baseline.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Labeling Comic Mischief Content in Online Videos with a Multimodal Hierarchical-Cross-Attention Model
We address the challenge of detecting questionable content in online media, specifically the subcategory of comic mischief. This type of content combines elements such as violence, adult content, or sarcasm with humor, m…
Query Efficient Decision Based Sparse Attacks Against Black-Box Deep Learning Models
Despite our best efforts, deep learning models remain highly vulnerable to even tiny adversarial perturbations applied to the inputs. The ability to extract information from solely the output of a machine learning model …
BIG-bench Machine LearningQUERY-EFFICIENT DECISION-BASED SPARSE ATTACKS AGAINST BLACK-BOX MACHINE LEARNING MODELS
Despite our best efforts, deep learning models remain highly vulnerable to even tiny adversarial perturbations applied to the inputs. The ability to extract information from solely the output of a machine learning model …
BIG-bench Machine LearningRobustBlack: Challenging Black-Box Adversarial Attacks on State-of-the-Art Defenses
Although adversarial robustness has been extensively studied in white-box settings, recent advances in black-box attacks (including transfer- and query-based approaches) are primarily benchmarked against weak defenses, l…
Adversarial RobustnessA Random Ensemble of Encrypted Vision Transformers for Adversarially Robust Defense
Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In previous studies, the use of models encrypted with a secret key was demonstrated to be robust against white-box attacks, but n…
Adversarial Robustnessimage-classificationImage Classification