paper-with-me

Papers

AdvQDet: Detecting Query-Based Adversarial Attacks with Adversarial Contrastive Prompt Tuning

2024-08-04 · Xin Wang, Kai Chen, Xingjun Ma, Zhineng Chen, Jingjing Chen, Yu-Gang Jiang

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks even under a black-box setting where the adversary can only query the model. Particularly, query-based black-box adversarial attacks estimate adversarial gradients based on the returned probability vectors of the target model for a sequence of queries. During this process, the queries made to the target model are intermediate adversarial examples crafted at the previous attack step, which share high similarities in the pixel space. Motivated by this observation, stateful detection methods have been proposed to detect and reject query-based attacks. While demonstrating promising results, these methods either have been evaded by more advanced attacks or suffer from low efficiency in terms of the number of shots (queries) required to detect different attacks. Arguably, the key challenge here is to assign high similarity scores for any two intermediate adversarial examples perturbed from the same clean image. To address this challenge, we propose a novel Adversarial Contrastive Prompt Tuning (ACPT) method to robustly fine-tune the CLIP image encoder to extract similar embeddings for any two intermediate adversarial queries. With ACPT, we further introduce a detection framework AdvQDet that can detect 7 state-of-the-art query-based attacks with $>99\%$ detection rate within 5 shots. We also show that ACPT is robust to 3 types of adaptive attacks. Code is available at https://github.com/xinwong/AdvQDet.

📄 PDF Abstract BibTeX arXiv:2408.01978

Code (1)

xinwong/advqdet 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Blacklight: Scalable Defense for Neural Networks against Query-Based Black-Box Attacks

2020-06-24 · Huiying Li, Shawn Shan, Emily Wenger, Jiayun Zhang 외

Deep learning systems are known to be vulnerable to adversarial examples. In particular, query-based black-box attacks do not require knowledge of the deep learning model, but can compute adversarial examples over the ne…

image-classificationImage Classificationtext-classificationText Classification

Fortify Machine Learning Production Systems: Detect and Classify Adversarial Attacks

2021-02-19 · Matthew Ciolino, Josh Kalin, David Noever

Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this wor…

Adversarial AttackBIG-bench Machine Learningimage-classificationImage Classification+1

Black-box Adversarial Attacks with Bayesian Optimization

2019-09-30 · Satya Narayan Shukla, Anit Kumar Sahu, Devin Willmott, J. Zico Kolter

We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples using information limited to loss function evaluations of input-output pairs. We use Bayesian optimization~(BO) …

Bayesian Optimization

Stateful Defenses for Machine Learning Models Are Not Yet Secure Against Black-box Attacks

2023-03-11 · Ryan Feng, Ashish Hooda, Neal Mangaokar, Kassem Fawaz 외

Recent work has proposed stateful defense models (SDMs) as a compelling strategy to defend against a black-box attacker who only has query access to the model, as is common for online machine learning platforms. Such sta…

Detecting Adversarial Data Using Perturbation Forgery

2025-01-01 · CVPR 2025 1 · Qian Wang, Chen Li, Yuchen Luo, Hefei Ling 외

As a defense strategy against adversarial attacks, adversarial detection aims to identify and filter out adversarial data from the data flow based on discrepancies in distribution and noise patterns between natural a…