paper-with-me

Papers

"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practice

2022-12-29 · Giovanni Apruzzese, Hyrum S. Anderson, Savino Dambra, David Freeman, Fabio Pierazzi, Kevin A. Roundy

Recent years have seen a proliferation of research on adversarial machine learning. Numerous papers demonstrate powerful algorithmic attacks against a wide variety of machine learning (ML) models, and numerous other papers propose defenses that can withstand most attacks. However, abundant real-world evidence suggests that actual attackers use simple tactics to subvert ML-driven systems, and as a result security practitioners have not prioritized adversarial ML defenses. Motivated by the apparent gap between researchers and practitioners, this position paper aims to bridge the two domains. We first present three real-world case studies from which we can glean practical insights unknown or neglected in research. Next we analyze all adversarial ML papers recently published in top security conferences, highlighting positive trends and blind spots. Finally, we state positions on precise and cost-driven threat modeling, collaboration between industry and academia, and reproducible research. We believe that our positions, if adopted, will increase the real-world impact of future endeavours in adversarial ML, bringing both researchers and practitioners closer to their shared goal of improving the security of ML systems.

📄 PDF Abstract BibTeX arXiv:2212.14315

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

How stealthy is stealthy? Studying the Efficacy of Black-Box Adversarial Attacks in the Real World

2025-06-03 · Francesco Panebianco, Mario D'Onghia, Stefano Zanero aand Michele Carminati

Deep learning systems, critical in domains like autonomous vehicles, are vulnerable to adversarial examples (crafted inputs designed to mislead classifiers). This study investigates black-box adversarial attacks in compu…

Autonomous Vehicles

Encoded Gradients Aggregation against Gradient Leakage in Federated Learning

2022-05-26 · Dun Zeng, Shiyu Liu, Siqi Liang, Zonghang Li 외

Federated learning enables isolated clients to train a shared model collaboratively by aggregating the locally-computed gradient updates. However, privacy information could be leaked from uploaded gradients and be expose…

Federated Learning

Data Poisoning Attacks on Federated Machine Learning

2020-04-19 · Gan Sun, Yang Cong, Jiahua Dong, Qiang Wang 외

Federated machine learning which enables resource constrained node devices (e.g., mobile phones and IoT devices) to learn a shared model while keeping the training data local, can provide privacy, security and economic b…

BIG-bench Machine LearningData PoisoningFederated LearningMulti-Task Learning

Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks

2019-12-29 · Zhaoxian Wu, Qing Ling, Tianyi Chen, Georgios B. Giannakis

This paper deals with distributed finite-sum optimization for learning over networks in the presence of malicious Byzantine attacks. To cope with such attacks, most resilient approaches so far combine stochastic gradient…

Bridging Adversarial Robustness and Gradient Interpretability

2019-03-27 · Beomsu Kim, Junghoon Seo, Taegyun Jeon

Adversarial training is a training scheme designed to counter adversarial attacks by augmenting the training dataset with adversarial examples. Surprisingly, several studies have observed that loss gradients from adversa…

Adversarial Robustness