Membership Model Inversion Attacks for Deep Networks

2019-10-09 · Samyadeep Basu, Rauf Izmailov, Chris Mesterharm

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of instancesused to train the targeted machine learning model. This so-called model inversionattack is based on sequential leveraging of classification scores towards obtaininghigh confidence representations for various classes. However, for deep networks,such procedures usually lead to unrecognizable representations that are uselessfor the adversary. In this paper, we introduce a more realistic definition of modelinversion, where the adversary is aware of the general purpose of the attackedmodel (for instance, whether it is an OCR system or a facial recognition system),and the goal is to find realistic class representations within the corresponding lower-dimensional manifold (of, respectively, general symbols or general faces). To thatend, we leverage properties of generative adversarial networks for constructinga connected lower-dimensional manifold, and demonstrate the efficiency of ourmodel inversion attack that is carried out within that manifold.

📄 PDF Abstract BibTeX arXiv:1910.04257

Code (0)

등록된 구현이 없습니다.

Tasks

modelOptical Character Recognition (OCR)

Defending Model Inversion and Membership Inference Attacks via Prediction Purification

2020-05-08 · Ziqi Yang, Bin Shao, Bohan Xuan, Ee-Chien Chang 외

Neural networks are susceptible to data inference attacks such as the model inversion attack and the membership inference attack, where the attacker could infer the reconstruction and the membership of a data sample from…

Inference Attack Membership Inference Attack

Purifier: Defending Data Inference Attacks via Transforming Confidence Scores

2022-12-01 · Ziqi Yang, Lijin Wang, Da Yang, Jie Wan 외

Neural networks are susceptible to data inference attacks such as the membership inference attack, the adversarial model inversion attack and the attribute inference attack, where the attacker could infer useful informat…

Attribute Inference Attack Membership Inference Attack

One Parameter Defense -- Defending against Data Inference Attacks via Differential Privacy

2022-03-13 · Dayong Ye, Sheng Shen, Tianqing Zhu, Bo Liu 외

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a datas…

Differentially Private Data Generative Models

2018-12-06 · Qingrong Chen, Chong Xiang, Minhui Xue, Bo Li 외

Deep neural networks (DNNs) have recently been widely adopted in various applications, and such success is largely due to a combination of algorithmic breakthroughs, computation resource improvements, and access to a lar…

BIG-bench Machine Learning Federated Learning Inference Attack Membership Inference Attack

Privacy Attacks Against Biometric Models with Fewer Samples: Incorporating the Output of Multiple Models

2022-09-22 · Sohaib Ahmad, Benjamin Fuller, Kaleel Mahmood

Authentication systems are vulnerable to model inversion attacks where an adversary is able to approximate the inverse of a target machine learning model. Biometric models are a prime candidate for this type of attack. T…