paper-with-me

Papers

Towards Lightweight Black-Box Attacks against Deep Neural Networks

2022-09-29 · Chenghao Sun, Yonggang Zhang, Wan Chaoqun, Qizhou Wang, Ya Li, Tongliang Liu, Bo Han, Xinmei Tian

Black-box attacks can generate adversarial examples without accessing the parameters of target model, largely exacerbating the threats of deployed deep neural networks (DNNs). However, previous works state that black-box attacks fail to mislead target models when their training data and outputs are inaccessible. In this work, we argue that black-box attacks can pose practical attacks in this extremely restrictive scenario where only several test samples are available. Specifically, we find that attacking the shallow layers of DNNs trained on a few test samples can generate powerful adversarial examples. As only a few samples are required, we refer to these attacks as lightweight black-box attacks. The main challenge to promoting lightweight attacks is to mitigate the adverse impact caused by the approximation error of shallow layers. As it is hard to mitigate the approximation error with few available samples, we propose Error TransFormer (ETF) for lightweight attacks. Namely, ETF transforms the approximation error in the parameter space into a perturbation in the feature space and alleviates the error by disturbing features. In experiments, lightweight black-box attacks with the proposed ETF achieve surprising results. For example, even if only 1 sample per category available, the attack success rate in lightweight black-box attacks is only about 3% lower than that of the black-box attacks with complete training data.

📄 PDF Abstract BibTeX arXiv:2209.14826

Code (1)

sunch-ustc/error_transformer 공식 구현

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Understanding the Robustness of Randomized Feature Defense Against Query-Based Adversarial Attacks

2023-10-01 · Quang H. Nguyen, Yingjie Lao, Tung Pham, Kok-Seng Wong 외

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an a…

Image Classification

Random Noise Defense Against Query-Based Black-Box Attacks

2021-04-23 · NeurIPS 2021 12 · Zeyu Qin, Yanbo Fan, Hongyuan Zha, Baoyuan Wu

The query-based black-box attacks have raised serious threats to machine learning models in many real applications. In this work, we study a lightweight defense method, dubbed Random Noise Defense (RND), which adds prope…

Adversarial Robustness

Stateful Defenses for Machine Learning Models Are Not Yet Secure Against Black-box Attacks

2023-03-11 · Ryan Feng, Ashish Hooda, Neal Mangaokar, Kassem Fawaz 외

Recent work has proposed stateful defense models (SDMs) as a compelling strategy to defend against a black-box attacker who only has query access to the model, as is common for online machine learning platforms. Such sta…

RobustBlack: Challenging Black-Box Adversarial Attacks on State-of-the-Art Defenses

2024-12-30 · Mohamed Djilani, Salah Ghamizi, Maxime Cordy

Although adversarial robustness has been extensively studied in white-box settings, recent advances in black-box attacks (including transfer- and query-based approaches) are primarily benchmarked against weak defenses, l…

Adversarial Robustness

Revisiting Personalized Federated Learning: Robustness Against Backdoor Attacks

2023-02-03 · Zeyu Qin, Liuyi Yao, Daoyuan Chen, Yaliang Li 외

In this work, besides improving prediction accuracy, we study whether personalization could bring robustness benefits to backdoor attacks. We conduct the first study of backdoor attacks in the pFL framework, testing 4 wi…

Backdoor AttackFederated LearningPersonalized Federated Learning