paper-with-me

홈 › Papers

Anonymity Unveiled: A Practical Framework for Auditing Data Use in Deep Learning Models

2024-09-10 · Zitao Chen, Karthik Pattabiraman

The rise of deep learning (DL) has led to a surging demand for training data, which incentivizes the creators of DL models to trawl through the Internet for training materials. Meanwhile, users often have limited control over whether their data (e.g., facial images) are used to train DL models without their consent, which has engendered pressing concerns. This work proposes MembershipTracker, a practical data auditing tool that can empower ordinary users to reliably detect the unauthorized use of their data in training DL models. We view data auditing through the lens of membership inference (MI). MembershipTracker consists of a lightweight data marking component to mark the target data with small and targeted changes, which can be strongly memorized by the model trained on them; and a specialized MI-based verification process to audit whether the model exhibits strong memorization on the target samples. MembershipTracker only requires the users to mark a small fraction of data (0.005% to 0.1% in proportion to the training set), and it enables the users to reliably detect the unauthorized use of their data (average 0% FPR@100% TPR). We show that MembershipTracker is highly effective across various settings, including industry-scale training on the full-size ImageNet-1k dataset. We finally evaluate MembershipTracker under multiple classes of countermeasures.

📄 PDF Abstract BibTeX arXiv:2409.06280

Code (0)

등록된 구현이 없습니다.

Tasks

Memorization

Similar Papers 제목 키워드 기반

A Story of Consistency: Bridging the Gap between Bentham and Rawls Foundations

2023-03-13 · Stéphane Gonzalez, Nikolaos Pnevmatikos

The axiomatic foundations of Bentham and Rawls solutions are discussed within the broader domain of cardinal preferences. It is unveiled that both solution concepts share all four of the following axioms: Nonemptiness, A…

Decision Making

Pragmatic auditing: a pilot-driven approach for auditing Machine Learning systems

2024-05-21 · Djalel Benbouzid, Christiane Plociennik, Laura Lucaj, Mihai Maftei 외

The growing adoption and deployment of Machine Learning (ML) systems came with its share of ethical incidents and societal concerns. It also unveiled the necessity to properly audit these systems in light of ethical prin…

Fair Play for Individuals, Foul Play for Groups? Auditing Anonymization's Impact on ML Fairness

2025-05-12 · Héber H. Arcolezi, Mina Alishahi, Adda-Akram Bendoukha, Nesrine Kaaniche

Machine learning (ML) algorithms are heavily based on the availability of training data, which, depending on the domain, often includes sensitive information about data providers. This raises critical privacy concerns. A…

Fairness

AnoFel: Supporting Anonymity for Privacy-Preserving Federated Learning

2023-06-12 · Ghada Almashaqbeh, Zahra Ghodsi

Federated learning enables users to collaboratively train a machine learning model over their private datasets. Secure aggregation protocols are employed to mitigate information leakage about the local datasets. This set…

Federated LearningPrivacy Preserving

Data Provenance via Differential Auditing

2022-09-04 · Xin Mu, Ming Pang, Feida Zhu

Auditing Data Provenance (ADP), i.e., auditing if a certain piece of data has been used to train a machine learning model, is an important problem in data provenance. The feasibility of the task has been demonstrated by …