paper-with-me

Papers

Effects of Differential Privacy and Data Skewness on Membership Inference Vulnerability

2019-11-21 · Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Wenqi Wei, Lei Yu

Membership inference attacks seek to infer the membership of individual training instances of a privately trained model. This paper presents a membership privacy analysis and evaluation system, called MPLens, with three unique contributions. First, through MPLens, we demonstrate how membership inference attack methods can be leveraged in adversarial machine learning. Second, through MPLens, we highlight how the vulnerability of pre-trained models under membership inference attack is not uniform across all classes, particularly when the training data itself is skewed. We show that risk from membership inference attacks is routinely increased when models use skewed training data. Finally, we investigate the effectiveness of differential privacy as a mitigation technique against membership inference attacks. We discuss the trade-offs of implementing such a mitigation strategy with respect to the model complexity, the learning task complexity, the dataset complexity and the privacy parameter settings. Our empirical results reveal that (1) minority groups within skewed datasets display increased risk for membership inference and (2) differential privacy presents many challenging trade-offs as a mitigation technique to membership inference risk.

📄 PDF Abstract BibTeX arXiv:1911.09777

Code (0)

등록된 구현이 없습니다.

Tasks

Inference AttackMembership Inference Attack

Similar Papers 제목 키워드 기반

Membership Inference Attack Susceptibility of Clinical Language Models

2021-04-16 · Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language proc…

Inference AttackMembership Inference Attack

Assessing differentially private deep learning with Membership Inference

2019-12-24 · Daniel Bernau, Philip-William Grassal, Jonas Robl, Florian Kerschbaum

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization o…

Deep LearningInference AttackMembership Inference Attack

The Influence of Dropout on Membership Inference in Differentially Private Models

2021-03-16 · Erick Galinkin

Differentially private models seek to protect the privacy of data the model is trained on, making it an important component of model security and privacy. At the same time, data scientists and machine learning engineers …

BIG-bench Machine LearningUncertainty Quantification

Modeling Neural Networks with Privacy Using Neural Stochastic Differential Equations

2025-01-12 · Sanghyun Hong, Fan Wu, Anthony Gruber, Kookjin Lee

In this work, we study the feasibility of using neural ordinary differential equations (NODEs) to model systems with intrinsic privacy properties. Unlike conventional feedforward neural networks, which have unlimited exp…

Language ModelingLanguage ModellingMemorization

One Parameter Defense -- Defending against Data Inference Attacks via Differential Privacy

2022-03-13 · Dayong Ye, Sheng Shen, Tianqing Zhu, Bo Liu 외

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a datas…