Assessing differentially private deep learning with Membership Inference
Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data or training function with differential privacy. However, data scientists can choose between local and central differential privacy and need to select meaningful privacy parameters $\epsilon$ which is challenging for non-privacy experts. We empirically compare local and central differential privacy mechanisms under white- and black-box membership inference to evaluate their relative privacy-accuracy trade-offs. We experiment with several datasets and show that this trade-off is similar for both types of mechanisms. This suggests that local differential privacy is a sound alternative to central differential privacy for differentially private deep learning, since small $\epsilon$ in central differential privacy and large $\epsilon$ in local differential privacy result in similar membership inference attack risk.
Code (1)
Tasks
Deep LearningInference AttackMembership Inference AttackSimilar Papers 제목 키워드 기반
The Influence of Dropout on Membership Inference in Differentially Private Models
Differentially private models seek to protect the privacy of data the model is trained on, making it an important component of model security and privacy. At the same time, data scientists and machine learning engineers …
BIG-bench Machine LearningUncertainty QuantificationAssessing Differentially Private Variational Autoencoders under Membership Inference
We present an approach to quantify and compare the privacy-accuracy trade-off for differentially private Variational Autoencoders. Our work complements previous work in two aspects. First, we evaluate the the strong reco…
Time SeriesTime Series AnalysisTabPATE: Differentially Private Tabular In-Context Learning Without Public Data
Tabular foundation models enable accurate in-context learning (ICL) from small labeled datasets, but the private records placed in context can leak through model predictions. We first show that even basic membership infe…
Differentially Private Data Generative Models
Deep neural networks (DNNs) have recently been widely adopted in various applications, and such success is largely due to a combination of algorithmic breakthroughs, computation resource improvements, and access to a lar…
BIG-bench Machine LearningFederated LearningInference AttackMembership Inference AttackOptimal privacy guarantees for a relaxed threat model: Addressing sub-optimal adversaries in differentially private machine learning
Differentially private mechanisms restrict the membership inference capabilities of powerful (optimal) adversaries against machine learning models. Such adversaries are rarely encountered in practice. In this work, we ex…