paper-with-me

홈 › Papers

Delving into Data: Effectively Substitute Training for Black-box Attack

2021-04-26 · CVPR 2021 1 · Wenxuan Wang, Bangjie Yin, Taiping Yao, Li Zhang, Yanwei Fu, Shouhong Ding, Jilin Li, Feiyue Huang, xiangyang xue

Deep models have shown their vulnerability when processing adversarial samples. As for the black-box attack, without access to the architecture and weights of the attacked model, training a substitute model for adversarial attacks has attracted wide attention. Previous substitute training approaches focus on stealing the knowledge of the target model based on real training data or synthetic data, without exploring what kind of data can further improve the transferability between the substitute and target models. In this paper, we propose a novel perspective substitute training that focuses on designing the distribution of data used in the knowledge stealing process. More specifically, a diverse data generation module is proposed to synthesize large-scale data with wide distribution. And adversarial substitute training strategy is introduced to focus on the data distributed near the decision boundary. The combination of these two modules can further boost the consistency of the substitute model and target model, which greatly improves the effectiveness of adversarial attack. Extensive experiments demonstrate the efficacy of our method against state-of-the-art competitors under non-target and target attack settings. Detailed visualization and analysis are also provided to help understand the advantage of our method.

📄 PDF Abstract BibTeX arXiv:2104.12378

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Attack

Similar Papers 제목 키워드 기반

A Survey of Reasoning for Substitution Relationships: Definitions, Methods, and Directions

2024-04-09 · Anxin Yang, Zhijuan Du, Tao Sun

Substitute relationships are fundamental to people's daily lives across various domains. This study aims to comprehend and predict substitute relationships among products in diverse fields, extensively analyzing the appl…

Recommendation Systems

Elo Uncovered: Robustness and Best Practices in Language Model Evaluation

2023-11-29 · Meriem Boubdir, Edward Kim, Beyza Ermis, Sara Hooker 외

In Natural Language Processing (NLP), the Elo rating system, originally designed for ranking players in dynamic games such as chess, is increasingly being used to evaluate Large Language Models (LLMs) through "A vs B" pa…

Language Model EvaluationLanguage ModelingLanguage Modelling

BERT-of-Theseus: Compressing BERT by Progressive Module Replacing

2020-02-07 · EMNLP 2020 11 · Canwen Xu, Wangchunshu Zhou, Tao Ge, Furu Wei 외

In this paper, we propose a novel model compression approach to effectively compress BERT by progressive module replacing. Our approach first divides the original BERT into several modules and builds their compact substi…

Knowledge DistillationModel Compression

DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memories

2021-11-08 · Adnan Siraj Rakin, Md Hafizul Islam Chowdhuryy, Fan Yao, Deliang Fan

Recent advancements of Deep Neural Networks (DNNs) have seen widespread deployment in multiple security-sensitive domains. The need of resource-intensive training and use of valuable domain-specific training data have ma…

Model extraction

Hubness and Pollution: Delving into Cross-Space Mapping for Zero-Shot Learning

2015-07-01 · IJCNLP 2015 7 · Angeliki Lazaridou, Georgiana Dinu, Marco Baroni
Semantic Textual SimilarityZero-Shot Learning