paper-with-me

홈 › Papers

AttriGuard: A Practical Defense Against Attribute Inference Attacks via Adversarial Machine Learning

2018-05-13 · Jinyuan Jia, Neil Zhenqiang Gong

Users in various web and mobile applications are vulnerable to attribute inference attacks, in which an attacker leverages a machine learning classifier to infer a target user's private attributes (e.g., location, sexual orientation, political view) from its public data (e.g., rating scores, page likes). Existing defenses leverage game theory or heuristics based on correlations between the public data and attributes. These defenses are not practical. Specifically, game-theoretic defenses require solving intractable optimization problems, while correlation-based defenses incur large utility loss of users' public data. In this paper, we present AttriGuard, a practical defense against attribute inference attacks. AttriGuard is computationally tractable and has small utility loss. Our AttriGuard works in two phases. Suppose we aim to protect a user's private attribute. In Phase I, for each value of the attribute, we find a minimum noise such that if we add the noise to the user's public data, then the attacker's classifier is very likely to infer the attribute value for the user. We find the minimum noise via adapting existing evasion attacks in adversarial machine learning. In Phase II, we sample one attribute value according to a certain probability distribution and add the corresponding noise found in Phase I to the user's public data. We formulate finding the probability distribution as solving a constrained convex optimization problem. We extensively evaluate AttriGuard and compare it with existing methods using a real-world dataset. Our results show that AttriGuard substantially outperforms existing methods. Our work is the first one that shows evasion attacks can be used as defensive techniques for privacy protection.

📄 PDF Abstract BibTeX arXiv:1805.04810

Code (1)

jjy1994/AttriGuard tf

Tasks

AttributeBIG-bench Machine Learning

Similar Papers 제목 키워드 기반

RAID: An In-Training Defense against Attribute Inference Attacks in Recommender Systems

2025-04-15 · Xiaohua Feng, Yuyuan Li, Fengyuan Yu, Ke Xiong 외

In various networks and mobile applications, users are highly susceptible to attribute inference attacks, with particularly prevalent occurrences in recommender systems. Attackers exploit partially exposed user profiles …

AttributeRecommendation Systems

Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs

2026-02-12 · Dong Yan, Jian Liang, Ran He, Tieniu Tan arxiv

Recent studies have shown that large language models (LLMs) can infer private user attributes (e.g., age, location, gender) from user-generated text shared online, enabling rapid and large-scale privacy breaches. Existin…

Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs

2021-05-23 · Chen Chen, Xuanli He, Lingjuan Lyu, Fangzhao Wu

The collection and availability of big data, combined with advances in pre-trained models (e.g., BERT, XLNET, etc), have revolutionized the predictive performance of modern natural language processing tasks, ranging from…

AttributeInference AttackModel extractiontext-classification+2

Human intuition as a defense against attribute inference

2023-04-24 · Marcin Waniek, Navya Suri, Abdullah Zameek, Bedoor AlShebli 외

Attribute inference - the process of analyzing publicly available data in order to uncover hidden information - has become a major threat to privacy, given the recent technological leap in machine learning. One way to ta…

Attribute

Analyzing Inference Privacy Risks Through Gradients in Machine Learning

2024-08-29 · Zhuohang Li, Andrew Lowy, Jing Liu, Toshiaki Koike-Akino 외

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper …

Attribute