paper-with-me

Papers

Towards Sharper First-Order Adversary with Quantized Gradients

2020-02-01 · Zhuanghua Liu, Ivor W. Tsang

Despite the huge success of Deep Neural Networks (DNNs) in a wide spectrum of machine learning and data mining tasks, recent research shows that this powerful tool is susceptible to maliciously crafted adversarial examples. Up until now, adversarial training has been the most successful defense against adversarial attacks. To increase adversarial robustness, a DNN can be trained with a combination of benign and adversarial examples generated by first-order methods. However, in state-of-the-art first-order attacks, adversarial examples with sign gradients retain the sign information of each gradient component but discard the relative magnitude between components. In this work, we replace sign gradients with quantized gradients. Gradient quantization not only preserves the sign information, but also keeps the relative magnitude between components. Experiments show white-box first-order attacks with quantized gradients outperform their variants with sign gradients on multiple datasets. Notably, our BLOB\_QG attack achieves an accuracy of $88.32\%$ on the secret MNIST model from the MNIST Challenge and it outperforms all other methods on the leaderboard of white-box attacks.

📄 PDF Abstract BibTeX arXiv:2002.02372

Code (1)

tianzheng4/Distributionally-Adversarial-Attack 공식 구현 tf

Tasks

Adversarial RobustnessQuantization

Similar Papers 제목 키워드 기반

Stability Based Generalization Bounds for Exponential Family Langevin Dynamics

2022-01-09 · Arindam Banerjee, Tiancong Chen, Xinyan Li, Yingxue Zhou

Recent years have seen advances in generalization bounds for noisy stochastic algorithms, especially stochastic gradient Langevin dynamics (SGLD) based on stability (Mou et al., 2018; Li et al., 2020) and information the…

Generalization Bounds

Improving the Straight-Through Estimator with Zeroth-Order Information

2025-10-27 · Ningfeng Yang, Tor M. Aamodt arxiv

We study the problem of training neural networks with quantized parameters. Learning low-precision quantized parameters by enabling computation of gradients via the Straight-Through Estimator (STE) can be challenging. Wh…

Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networks

2026-01-31 · Tian Zhang, Yujia Tong, Junhao Dong, Ke Xu 외 arxiv

The deployment of quantized neural networks on edge devices, combined with privacy regulations like GDPR, creates an urgent need for machine unlearning in quantized models. However, existing methods face critical challen…

Fine-tuning Quantized Neural Networks with Zeroth-order Optimization

2025-05-19 · Sifeng Shang, Jiayi Zhou, Chenyu Lin, Minxian Li 외

As the size of large language models grows exponentially, GPU memory has become a bottleneck for adapting these models to downstream tasks. In this paper, we aim to push the limits of memory-efficient training by minimiz…

GPUQuantization

Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients

2019-09-17 · NeurIPS 2019 12 · Jun Sun, Tianyi Chen, Georgios B. Giannakis, Zaiyue Yang

The present paper develops a novel aggregated gradient approach for distributed machine learning that adaptively compresses the gradient communication. The key idea is to first quantize the computed gradients, and then s…