paper-with-me

Papers

Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearning

2023-10-28 · Zheyuan Liu, Guangyao Dou, Yijun Tian, Chunhui Zhang, Eli Chien, Ziwei Zhu

Machine Unlearning (MU) algorithms have become increasingly critical due to the imperative adherence to data privacy regulations. The primary objective of MU is to erase the influence of specific data samples on a given model without the need to retrain it from scratch. Accordingly, existing methods focus on maximizing user privacy protection. However, there are different degrees of privacy regulations for each real-world web-based application. Exploring the full spectrum of trade-offs between privacy, model utility, and runtime efficiency is critical for practical unlearning scenarios. Furthermore, designing the MU algorithm with simple control of the aforementioned trade-off is desirable but challenging due to the inherent complex interaction. To address the challenges, we present Controllable Machine Unlearning (ConMU), a novel framework designed to facilitate the calibration of MU. The ConMU framework contains three integral modules: an important data selection module that reconciles the runtime efficiency and model generalization, a progressive Gaussian mechanism module that balances privacy and model generalization, and an unlearning proxy that controls the trade-offs between privacy and runtime efficiency. Comprehensive experiments on various benchmark datasets have demonstrated the robust adaptability of our control mechanism and its superiority over established unlearning methods. ConMU explores the full spectrum of the Privacy-Utility-Efficiency trade-off and allows practitioners to account for different real-world regulations. Source code available at: https://github.com/guangyaodou/ConMU.

📄 PDF Abstract BibTeX arXiv:2310.18574

Code (1)

guangyaodou/conmu 공식 구현 pytorch

Tasks

Machine Unlearning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

OSNIP: Breaking the Privacy-Utility-Efficiency Trilemma in LLM Inference via Obfuscated Semantic Null Space

2026-01-30 · Zhiyuan Cao, Zeyu Ma, Chenhao Yang, Han Zheng 외 arxiv

We propose Obfuscated Semantic Null space Injection for Privacy (OSNIP), a lightweight client-side encryption framework for privacy-preserving LLM inference. Generalizing the geometric intuition of linear kernels to the …

Beyond the Generative Learning Trilemma: Generative Model Assessment in Data Scarcity Domains

2025-04-14 · Marco Salmè, Lorenzo Tronchin, Rosa Sicilia, Paolo Soda 외

Data scarcity remains a critical bottleneck impeding technological advancements across various domains, including but not limited to medicine and precision agriculture. To address this challenge, we explore the potential…

Breaking the Communication-Privacy-Accuracy Trilemma

2020-07-22 · NeurIPS 2020 12 · Wei-Ning Chen, Peter Kairouz, Ayfer Özgür

Two major challenges in distributed learning and estimation are 1) preserving the privacy of the local samples; and 2) communicating them efficiently to a central server, while achieving high accuracy for the end-to-end …

FERRET: Private Deep Learning Faster And Better Than DPSGD

2025-06-04 · David Zagardo

We revisit 1-bit gradient compression through the lens of mutual-information differential privacy (MI-DP). Building on signSGD, we propose FERRET--Fast and Effective Restricted Release for Ethical Training--which transmi…

Deep Learning

Breaking the MoE LLM Trilemma: Dynamic Expert Clustering with Structured Compression

2025-09-27 · Peijun Zhu, Ning Yang, Baoliang Tian, Jiayu Wei 외 arxiv

Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structure…

Online Clustering