paper-with-me

Papers

UnSplit: Data-Oblivious Model Inversion, Model Stealing, and Label Inference Attacks Against Split Learning

2021-08-20 · Ege Erdogan, Alptekin Kupcu, A. Ercument Cicek

Training deep neural networks often forces users to work in a distributed or outsourced setting, accompanied with privacy concerns. Split learning aims to address this concern by distributing the model among a client and a server. The scheme supposedly provides privacy, since the server cannot see the clients' models and inputs. We show that this is not true via two novel attacks. (1) We show that an honest-but-curious split learning server, equipped only with the knowledge of the client neural network architecture, can recover the input samples and obtain a functionally similar model to the client model, without being detected. (2) We show that if the client keeps hidden only the output layer of the model to "protect" the private labels, the honest-but-curious server can infer the labels with perfect accuracy. We test our attacks using various benchmark datasets and against proposed privacy-enhancing extensions to split learning. Our results show that plaintext split learning can pose serious risks, ranging from data (input) privacy to intellectual property (model parameters), and provide no more than a false sense of security.

📄 PDF Abstract BibTeX arXiv:2108.09033

Code (1)

ege-erdogan/unsplit 공식 구현 pytorch

Tasks

model

Similar Papers 제목 키워드 기반

Can't Steal? Cont-Steal! Contrastive Stealing Attacks Against Image Encoders

2022-01-19 · CVPR 2023 1 · Zeyang Sha, Xinlei He, Ning Yu, Michael Backes 외

Self-supervised representation learning techniques have been developing rapidly to make full use of unlabeled images. They encode images into rich features that are oblivious to downstream tasks. Behind their revolutiona…

Contrastive LearningRepresentation Learning

Data-Free Hard-Label Robustness Stealing Attack

2023-12-10 · Xiaojian Yuan, Kejiang Chen, Wen Huang, Jie Zhang 외

The popularity of Machine Learning as a Service (MLaaS) has led to increased concerns about Model Stealing Attacks (MSA), which aim to craft a clone model by querying MLaaS. Currently, most research on MSA assumes that M…

Defending Against Model Stealing Attacks with Adaptive Misinformation

2019-11-16 · CVPR 2020 6 · Sanjay Kariyappa, Moinuddin K. Qureshi

Deep Neural Networks (DNNs) are susceptible to model stealing attacks, which allows a data-limited adversary with no knowledge of the training dataset to clone the functionality of a target model, just by using black-box…

Misinformationmodel

On the Limitations of Model Stealing with Uncertainty Quantification Models

2023-05-09 · David Pape, Sina Däubener, Thorsten Eisenhofer, Antonio Emanuele Cinà 외

Model stealing aims at inferring a victim model's functionality at a fraction of the original training cost. While the goal is clear, in practice the model's architecture, weight dimension, and original training data can…

DiversityUncertainty Quantification

GPT, But Backwards: Exactly Inverting Language Model Outputs

2025-07-02 · Adrians Skapars, Edoardo Manino, Youcheng Sun, Lucas C. Cordeiro arxiv

The task of reconstructing unknown textual inputs to language models is a fundamental auditing primitive that allows us to assess the model's vulnerability to a range of security issues, including stealing hidden system …