paper-with-me

홈 › Papers

DeMem: Privacy-Enhanced Robust Adversarial Learning via De-Memorization

2024-12-08 · Xiaoyu Luo, Qiongxiu Li

Adversarial robustness, the ability of a model to withstand manipulated inputs that cause errors, is essential for ensuring the trustworthiness of machine learning models in real-world applications. However, previous studies have shown that enhancing adversarial robustness through adversarial training increases vulnerability to privacy attacks. While differential privacy can mitigate these attacks, it often compromises robustness against both natural and adversarial samples. Our analysis reveals that differential privacy disproportionately impacts low-risk samples, causing an unintended performance drop. To address this, we propose DeMem, which selectively targets high-risk samples, achieving a better balance between privacy protection and model robustness. DeMem is versatile and can be seamlessly integrated into various adversarial training techniques. Extensive evaluations across multiple training methods and datasets demonstrate that DeMem significantly reduces privacy leakage while maintaining robustness against both natural and adversarial samples. These results confirm DeMem's effectiveness and broad applicability in enhancing privacy without compromising robustness.

📄 PDF Abstract BibTeX arXiv:2412.05767

Code (1)

xiaoyuluoit97/DeMem 공식 구현 pytorch

Tasks

Adversarial RobustnessMemorization

Similar Papers 제목 키워드 기반

Preserving Privacy Through Dememorization: An Unlearning Technique For Mitigating Memorization Risks In Language Models

2023-12-09 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing 2023 12 · Aly Kassem, Omar Mahmoud, Sherif Saad

Large Language models (LLMs) are trained on vast amounts of data, including sensitive information that poses a risk to personal privacy if exposed. LLMs have shown the ability to memorize and reproduce portions of their …

Language ModelingLanguage ModellingMemorization

SoK: Unlearnability and Unlearning for Model Dememorization

2026-05-12 · Mengying Zhang, Derui Wang, Ruoxi Sun, Xiaoyu Xia 외 arxiv

Advanced model dememorization methods, including availability poisoning (unlearnability) and machine unlearning, are emerging as key safeguards against data misuse in machine learning (ML). At the training stage, unlearn…

DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models

2023-10-31 · Xinwei Wu, Junzhuo Li, Minghui Xu, Weilong Dong 외

Large language models pretrained on a huge amount of data capture rich knowledge and information in the training data. The ability of data memorization and regurgitation in pretrained language models, revealed in previou…

MemorizationModel Editing

Beyond Memorization: Selective Learning for Copyright-Safe Diffusion Model Training

2025-12-12 · Divya Kothandaraman, Jaclyn Pytlarz arxiv

Memorization in large-scale text-to-image diffusion models poses significant security and intellectual property risks, enabling adversarial attribute extraction and the unauthorized reproduction of sensitive or proprieta…

Attribute Extraction

On the Privacy Effect of Data Enhancement via the Lens of Memorization

2022-08-17 · Xiao Li, Qiongxiu Li, Zhanhao Hu, Xiaolin Hu

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augme…

Adversarial RobustnessData AugmentationMemorization