paper-with-me

Papers

High Accuracy and High Fidelity Extraction of Neural Networks

2019-09-03 · Matthew Jagielski, Nicholas Carlini, David Berthelot, Alex Kurakin, Nicolas Papernot

In a model extraction attack, an adversary steals a copy of a remotely deployed machine learning model, given oracle prediction access. We taxonomize model extraction attacks around two objectives: *accuracy*, i.e., performing well on the underlying learning task, and *fidelity*, i.e., matching the predictions of the remote victim classifier on any input. To extract a high-accuracy model, we develop a learning-based attack exploiting the victim to supervise the training of an extracted model. Through analytical and empirical arguments, we then explain the inherent limitations that prevent any learning-based strategy from extracting a truly high-fidelity model---i.e., extracting a functionally-equivalent model whose predictions are identical to those of the victim model on all possible inputs. Addressing these limitations, we expand on prior work to develop the first practical functionally-equivalent extraction attack for direct extraction (i.e., without training) of a model's weights. We perform experiments both on academic datasets and a state-of-the-art image classifier trained with 1 billion proprietary images. In addition to broadening the scope of model extraction research, our work demonstrates the practicality of model extraction attacks against production-grade systems.

📄 PDF Abstract BibTeX arXiv:1909.01838

Code (0)

등록된 구현이 없습니다.

Tasks

Model extractionVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Evaluating Query Efficiency and Accuracy of Transfer Learning-based Model Extraction Attack in Federated Learning

2025-05-25 · Sayyed Farid Ahamed, Sandip Roy, Soumya Banerjee, Marc Vucovich 외

Federated Learning (FL) is a collaborative learning framework designed to protect client data, yet it remains highly vulnerable to Intellectual Property (IP) threats. Model extraction (ME) attacks pose a significant risk…

Federated LearningModel extractionPrivacy PreservingTransfer Learning

Model extraction from counterfactual explanations

2020-09-03 · Ulrich Aïvodji, Alexandre Bolot, Sébastien Gambs

Post-hoc explanation techniques refer to a posteriori methods that can be used to explain how black-box machine learning models produce their outcomes. Among post-hoc explanation techniques, counterfactual explanations a…

counterfactualmodelModel extraction

MedPromptExtract (Medical Data Extraction Tool): Anonymization and Hi-fidelity Automated data extraction using NLP and prompt engineering

2024-05-04 · Roomani Srivastava, Suraj Prasad, Lipika Bhat, Sarvesh Deshpande 외

Introduction: The labour-intensive nature of data extraction from sources like discharge summaries (DS) poses significant obstacles to the digitisation of medical records particularly for low- and middle-income countries…

Information RetrievalLarge Language ModelPrompt Engineering

Metafeatures-based Rule-Extraction for Classifiers on Behavioral and Textual Data

2020-03-10 · Yanou Ramon, David Martens, Theodoros Evgeniou, Stiene Praet

Machine learning models on behavioral and textual data can result in highly accurate prediction models, but are often very difficult to interpret. Rule-extraction techniques have been proposed to combine the desired pred…

Model Extraction and Defenses on Generative Adversarial Networks

2021-01-06 · Hailong Hu, Jun Pang

Model extraction attacks aim to duplicate a machine learning model through query access to a target model. Early studies mainly focus on discriminative models. Despite the success, model extraction attacks against genera…

modelModel extraction