paper-with-me

Papers

Do Backdoors Assist Membership Inference Attacks?

2023-03-22 · Yumeki Goto, Nami Ashizawa, Toshiki Shibahara, Naoto Yanai

When an adversary provides poison samples to a machine learning model, privacy leakage, such as membership inference attacks that infer whether a sample was included in the training of the model, becomes effective by moving the sample to an outlier. However, the attacks can be detected because inference accuracy deteriorates due to poison samples. In this paper, we discuss a \textit{backdoor-assisted membership inference attack}, a novel membership inference attack based on backdoors that return the adversary's expected output for a triggered sample. We found three crucial insights through experiments with an academic benchmark dataset. We first demonstrate that the backdoor-assisted membership inference attack is unsuccessful. Second, when we analyzed loss distributions to understand the reason for the unsuccessful results, we found that backdoors cannot separate loss distributions of training and non-training samples. In other words, backdoors cannot affect the distribution of clean samples. Third, we also show that poison and triggered samples activate neurons of different distributions. Specifically, backdoors make any clean sample an inlier, contrary to poisoning samples. As a result, we confirm that backdoors cannot assist membership inference.

📄 PDF Abstract BibTeX arXiv:2303.12589

Code (0)

등록된 구현이 없습니다.

Tasks

Inference AttackMembership Inference Attack

Similar Papers 제목 키워드 기반

Label-Only Membership Inference Attacks

2020-07-28 · Christopher A. Choquette-Choo, Florian Tramer, Nicholas Carlini, Nicolas Papernot

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership infere…

L2 Regularization

On the (In)Feasibility of Attribute Inference Attacks on Machine Learning Models

2021-03-12 · Benjamin Zi Hao Zhao, Aviral Agrawal, Catisha Coburn, Hassan Jameel Asghar 외

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that th…

AttributeBIG-bench Machine LearningInference Attack

Membership-Doctor: Comprehensive Assessment of Membership Inference Against Machine Learning Models

2022-08-22 · Xinlei He, Zheng Li, Weilin Xu, Cory Cornelius 외

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to infer whether an input sample was used to train the model. Over the pas…

Data Augmentation

Reconstruction and Membership Inference Attacks against Generative Models

2019-06-07 · Benjamin Hilprecht, Martin Härterich, Daniel Bernau

We present two information leakage attacks that outperform previous work on membership inference against generative models. The first attack allows membership inference without assumptions on the type of the generative m…

Density EstimationInference AttackMembership Inference Attack

An Extension of Fano's Inequality for Characterizing Model Susceptibility to Membership Inference Attacks

2020-09-17 · Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Sunny Raj 외

Deep neural networks have been shown to be vulnerable to membership inference attacks wherein the attacker aims to detect whether specific input data were used to train the model. These attacks can potentially leak priva…

Inference AttackMembership Inference Attack