paper-with-me

홈 › Papers

Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning

2024-07-01 · Nexhi Sula, Abhinav Kumar, Jie Hou, Han Wang, Reza Tourani

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as GDPR, a secure machine learning framework should not only grant users the right to request the removal of their contributed data used for model training but also facilitates the elimination of sensitive data fingerprints within machine learning models to mitigate potential attack - a process referred to as machine unlearning. In this study, we present a novel unlearning mechanism designed to effectively remove the impact of specific data samples from a neural network while considering the performance of the unlearned model on the primary task. In achieving this goal, we crafted a novel loss function tailored to eliminate privacy-sensitive information from weights and activation values of the target model by combining target classification loss and membership inference loss. Our adaptable framework can easily incorporate various privacy leakage approximation mechanisms to guide the unlearning process. We provide empirical evidence of the effectiveness of our unlearning approach with a theoretical upper-bound analysis through a membership inference mechanism as a proof of concept. Our results showcase the superior performance of our approach in terms of unlearning efficacy and latency as well as the fidelity of the primary task, across four datasets and four deep learning architectures.

📄 PDF Abstract BibTeX arXiv:2407.00866

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Unlearning

Similar Papers 제목 키워드 기반

MIDST Challenge at SaTML 2025: Membership Inference over Diffusion-models-based Synthetic Tabular data

2026-03-19 · Masoumeh Shafieinejad, Xi He, Mahshid Alinoori, John Jewell 외 arxiv

Synthetic data is often perceived as a silver-bullet solution to data anonymization and privacy-preserving data publishing. Drawn from generative models like diffusion models, synthetic data is expected to preserve the s…

A Unified Membership Inference Method for Visual Self-supervised Encoder via Part-aware Capability

2024-04-03 · Jie Zhu, Jirong Zha, Ding Li, Leye Wang

Self-supervised learning shows promise in harnessing extensive unlabeled data, but it also confronts significant privacy concerns, especially in vision. In this paper, we aim to perform membership inference on visual sel…

Contrastive LearningSelf-Supervised Learning

Harnessing Membership Function Dynamics for Stability Analysis of T-S Fuzzy Systems

2024-01-04 · Donghwan Lee, Do-Wan Kim

The main goal of this paper is to develop a new linear matrix inequality (LMI) condition for the asymptotic stability of continuous-time Takagi-Sugeno (T-S) fuzzy systems. A key advantage of this new condition is its ind…

A Unified and Scalable Membership Inference Method for Visual Self-supervised Encoder via Part-aware Capability

2025-05-15 · Jie Zhu, Jirong Zha, Ding Li, Leye Wang

Self-supervised learning shows promise in harnessing extensive unlabeled data, but it also confronts significant privacy concerns, especially in vision. In this paper, we perform membership inference on visual self-super…

Contrastive LearningSelf-Supervised Learning

Last One Standing: A Comparative Analysis of Security and Privacy of Soft Prompt Tuning, LoRA, and In-Context Learning

2023-10-17 · Rui Wen, Tianhao Wang, Michael Backes, Yang Zhang 외

Large Language Models (LLMs) are powerful tools for natural language processing, enabling novel applications and user experiences. However, to achieve optimal performance, LLMs often require adaptation with private data,…

In-Context Learning