paper-with-me

홈 › Papers

Confidence Is All You Need for MI Attacks

2023-11-26 · Abhishek Sinha, Himanshi Tibrewal, Mansi Gupta, Nikhar Waghela, Shivank Garg

In this evolving era of machine learning security, membership inference attacks have emerged as a potent threat to the confidentiality of sensitive data. In this attack, adversaries aim to determine whether a particular point was used during the training of a target model. This paper proposes a new method to gauge a data point's membership in a model's training set. Instead of correlating loss with membership, as is traditionally done, we have leveraged the fact that training examples generally exhibit higher confidence values when classified into their actual class. During training, the model is essentially being 'fit' to the training data and might face particular difficulties in generalization to unseen data. This asymmetry leads to the model achieving higher confidence on the training data as it exploits the specific patterns and noise present in the training data. Our proposed approach leverages the confidence values generated by the machine learning model. These confidence values provide a probabilistic measure of the model's certainty in its predictions and can further be used to infer the membership of a given data point. Additionally, we also introduce another variant of our method that allows us to carry out this attack without knowing the ground truth(true class) of a given data point, thus offering an edge over existing label-dependent attack methods.

📄 PDF Abstract BibTeX arXiv:2311.15373

Code (1)

vlgiitr/confidence-is-all-you-need 공식 구현 jax

Tasks

All

Similar Papers 제목 키워드 기반

On the Robustness of Verbal Confidence of LLMs in Adversarial Attacks

2025-07-09 · Stephen Obadinma, Xiaodan Zhu arxiv

Robust verbal confidence generated by large language models (LLMs) is crucial for the deployment of LLMs to help ensure transparency, trust, and safety in many applications, including those involving human-AI interaction…

An Efficient and Margin-Approaching Zero-Confidence Adversarial Attack

2019-10-01 · ICLR 2019 5 · Yang Zhang, Shiyu Chang, Mo Yu, Kaizhi Qian

There are two major paradigms of white-box adversarial attacks that attempt to impose input perturbations. The first paradigm, called the fix-perturbation attack, crafts adversarial samples within a given perturbation le…

Adversarial Attack

Revisiting Model's Uncertainty and Confidences for Adversarial Example Detection

2021-03-09 · Ahmed Aldahdooh, Wassim Hamidouche, Olivier Déforges

Security-sensitive applications that rely on Deep Neural Networks (DNNs) are vulnerable to small perturbations that are crafted to generate Adversarial Examples(AEs). The AEs are imperceptible to humans and cause DNN to …

Multi-Task LearningTransfer Learning

SoK: Pitfalls in Evaluating Black-Box Attacks

2023-10-26 · Fnu Suya, Anshuman Suri, Tingwei Zhang, Jingtao Hong 외

Numerous works study black-box attacks on image classifiers. However, these works make different assumptions on the adversary's knowledge and current literature lacks a cohesive organization centered around the threat mo…

Label-Only Membership Inference Attacks

2020-07-28 · Christopher A. Choquette-Choo, Florian Tramer, Nicholas Carlini, Nicolas Papernot

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership infere…

L2 Regularization