SHARP: Search-Based Adversarial Attack for Structured Prediction
Adversarial attack of structured prediction models faces various challenges such as the difficulty of perturbing discrete words, the sentence quality issue, and the sensitivity of outputs to small perturbations. In this work, we introduce SHARP, a new attack method that formulates the black-box adversarial attack as a search-based optimization problem with a specially designed objective function considering sentence fluency, meaning preservation and attacking effectiveness. Additionally, three different searching strategies are analyzed and compared, i.e., Beam Search, Metropolis-Hastings Sampling, and Hybrid Search. We demonstrate the effectiveness of our attacking strategies on two challenging structured prediction tasks: Pos-tagging and dependency parsing. Through automatic and human evaluations, we show that our method performs a more potent attack compared with pioneer arts. Moreover, the generated adversarial examples can be used to successfully boost the robustness and performance of the victim model via adversarial training.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackDependency ParsingPOSPOS TaggingPredictionSentenceStructured PredictionSimilar Papers 제목 키워드 기반
Adversarial Attack and Defense of Structured Prediction Models
Building an effective adversarial attacker and elaborating on countermeasures for adversarial attacks for natural language processing (NLP) have attracted a lot of research in recent years. However, most of the existing …
Adversarial AttackDependency ParsingPart-Of-Speech TaggingPrediction+2Sharpness-Aware Geometric Defense for Robust Out-Of-Distribution Detection
Out-of-distribution (OOD) detection ensures safe and reliable model deployment. Contemporary OOD algorithms using geometry projection can detect OOD or adversarial samples from clean in-distribution (ID) samples. However…
Out-of-Distribution DetectionAdversarial Attack on Graph Structured Data
Deep learning on graph structures has shown exciting results in various applications. However, few attentions have been paid to the robustness of such models, in contrast to numerous research work for image or text adver…
Adversarial AttackGraph Neural NetworkReinforcement LearningA Targeted Universal Attack on Graph Convolutional Network
Graph-structured data exist in numerous applications in real life. As a state-of-the-art graph neural network, the graph convolutional network (GCN) plays an important role in processing graph-structured data. However, a…
Adversarial AttackGraph Neural NetworkInfraQR: Edge-Placed QR-Inspired Structured Patch Attacks on Infrared Vision-Language Models
Infrared vision-language models are increasingly used for perception under low-light and adverse visual conditions, yet their robustness to localized structured perturbations remains underexplored. Existing infrared adve…
Visual Question Answering