Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs
Machine-learning-as-a-service (MLaaS) has attracted millions of users to their splendid large-scale models. Although published as black-box APIs, the valuable models behind these services are still vulnerable to imitation attacks. Recently, a series of works have demonstrated that attackers manage to steal or extract the victim models. Nonetheless, none of the previous stolen models can outperform the original black-box APIs. In this work, we conduct unsupervised domain adaptation and multi-victim ensemble to showing that attackers could potentially surpass victims, which is beyond previous understanding of model extraction. Extensive experiments on both benchmark datasets and real-world APIs validate that the imitators can succeed in outperforming the original black-box models on transferred domains. We consider our work as a milestone in the research of imitation attack, especially on NLP APIs, as the superior performance could influence the defense or even publishing strategy of API providers.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationModel extractionUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Black-Box On-Policy Distillation of Large Language Models
Black-box distillation creates student large language models (LLMs) by learning from a proprietary teacher model's text outputs alone, without access to its internal logits or parameters. In this work, we introduce Gener…
Knowledge DistillationBlack-Box Ripper: Copying black-box models using generative evolutionary algorithms
We study the task of replicating the functionality of black-box neural models, for which we only know the output class probabilities provided for a set of input images. We assume back-propagation through the black-box mo…
Evolutionary AlgorithmsModel Inversion Attack against Transfer Learning: Inverting a Model without Accessing It
Transfer learning is an important approach that produces pre-trained teacher models which can be used to quickly build specialized student models. However, recent research on transfer learning has found that it is vulner…
modelTransfer LearningTeach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
We investigate whether knowledge distillation (KD) from multiple heterogeneous teacher models can enhance the generation of transferable adversarial examples. A lightweight student model is trained using two KD strategie…
Knowledge DistillationModel CompressionFaceLeaks: Inference Attacks against Transfer Learning Models via Black-box Queries
Transfer learning is a useful machine learning framework that allows one to build task-specific models (student models) without significantly incurring training costs using a single powerful model (teacher model) pre-tra…
Face RecognitionTransfer Learning