paper-with-me

Papers

Projection & Probability-Driven Black-Box Attack

2020-05-08 · CVPR 2020 6 · Jie Li, Rongrong Ji, Hong Liu, Jianzhuang Liu, Bineng Zhong, Cheng Deng, Qi Tian

Generating adversarial examples in a black-box setting retains a significant challenge with vast practical application prospects. In particular, existing black-box attacks suffer from the need for excessive queries, as it is non-trivial to find an appropriate direction to optimize in the high-dimensional space. In this paper, we propose Projection & Probability-driven Black-box Attack (PPBA) to tackle this problem by reducing the solution space and providing better optimization. For reducing the solution space, we first model the adversarial perturbation optimization problem as a process of recovering frequency-sparse perturbations with compressed sensing, under the setting that random noise in the low-frequency space is more likely to be adversarial. We then propose a simple method to construct a low-frequency constrained sensing matrix, which works as a plug-and-play projection matrix to reduce the dimensionality. Such a sensing matrix is shown to be flexible enough to be integrated into existing methods like NES and Bandits$_{TD}$. For better optimization, we perform a random walk with a probability-driven strategy, which utilizes all queries over the whole progress to make full use of the sensing matrix for a less query budget. Extensive experiments show that our method requires at most 24% fewer queries with a higher attack success rate compared with state-of-the-art approaches. Finally, the attack method is evaluated on the real-world online service, i.e., Google Cloud Vision API, which further demonstrates our practical potentials.

📄 PDF Abstract BibTeX arXiv:2005.03837

Code (1)

theFool32/PPBA 공식 구현 pytorch

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

Nonlinear Projection Based Gradient Estimation for Query Efficient Blackbox Attacks

2021-02-25 · Huichen Li, Linyi Li, Xiaojun Xu, Xiaolu Zhang 외

Gradient estimation and vector space projection have been studied as two distinct topics. We aim to bridge the gap between the two by investigating how to efficiently estimate gradient based on a projected low-dimensiona…

Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attack

2021-05-03 · NeurIPS 2021 12 · Yixu Wang, Jie Li, Hong Liu, Yan Wang 외

Previous studies have verified that the functionality of black-box models can be stolen with full probability outputs. However, under the more practical hard-label setting, we observe that existing methods suffer from ca…

Knowledge DistillationSelf-Knowledge Distillation

Target-driven Attack for Large Language Models

2024-11-09 · Chong Zhang, Mingyu Jin, Dong Shu, Taowen Wang 외

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing…

Adversarial TextLanguage ModelingLanguage ModellingMisinformation

Semantic Adversarial Attacks on Face Recognition through Significant Attributes

2023-01-28 · Yasmeen M. Khedr, Yifeng Xiong, Kun He

Face recognition is known to be vulnerable to adversarial face images. Existing works craft face adversarial images by indiscriminately changing a single attribute without being aware of the intrinsic attributes of the i…

Adversarial AttackAttributeFace RecognitionFace Verification

A Black-box Attack on Neural Networks Based on Swarm Evolutionary Algorithm

2019-01-26 · Xiaolei Liu, Yuheng Luo, Xiaosong Zhang, Qingxin Zhu

Neural networks play an increasingly important role in the field of machine learning and are included in many applications in society. Unfortunately, neural networks suffer from adversarial samples generated to attack th…

Evolutionary Algorithms