paper-with-me

홈 › Papers

Orthogonal Soft Pruning for Efficient Class Unlearning

2025-06-24 · Qinghui Gong, Xue Yang, Xiaohu Tang

Machine unlearning aims to selectively remove class-specific knowledge from pretrained neural networks to satisfy privacy regulations such as the GDPR. Existing methods typically face a trade-off between unlearning speed and preservation of predictive accuracy, often incurring either high computational overhead or significant performance degradation on retained classes. In this paper, we propose a novel class-aware soft pruning framework leveraging orthogonal convolutional kernel regularization to achieve rapid and precise forgetting with millisecond-level response times. By enforcing orthogonality constraints during training, our method decorrelates convolutional filters and disentangles feature representations, while efficiently identifying class-specific channels through activation difference analysis. Extensive evaluations across multiple architectures and datasets demonstrate stable pruning with near-instant execution, complete forgetting of targeted classes, and minimal accuracy loss on retained data. Experiments on CIFAR-10, CIFAR-100, and TinyImageNet confirm that our approach substantially reduces membership inference attack risks and accelerates unlearning by orders of magnitude compared to state-of-the-art baselines. This framework provides an efficient, practical solution for real-time machine unlearning in Machine Learning as a Service (MLaaS) scenarios.

📄 PDF Abstract BibTeX arXiv:2506.19891

Code (0)

등록된 구현이 없습니다.

Tasks

Inference AttackMachine UnlearningMembership Inference Attack

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Pruning 설명 없음

Similar Papers 제목 키워드 기반

The Right to be Forgotten in Pruning: Unveil Machine Unlearning on Sparse Models

2025-07-24 · Yang Xiao, Gen Li, Jie Ji, Ruimeng Ye 외 arxiv

Machine unlearning aims to efficiently eliminate the memory about deleted data from trained models and address the right to be forgotten. Despite the success of existing unlearning algorithms, unlearning in sparse models…

Roots Beneath the Cut: Uncovering the Risk of Concept Revival in Pruning-Based Unlearning for Diffusion Models

2026-02-28 · Ci Zhang, Zhaojun Ding, Chence Yang, Jun Liu 외 arxiv

Pruning-based unlearning has recently emerged as a fast, training-free, and data-independent approach to remove undesired concepts from diffusion models. It promises high efficiency and robustness, offering an attractive…

Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networks

2026-01-31 · Tian Zhang, Yujia Tong, Junhao Dong, Ke Xu 외 arxiv

The deployment of quantized neural networks on edge devices, combined with privacy regulations like GDPR, creates an urgent need for machine unlearning in quantized models. However, existing methods face critical challen…

Out-of-Distributed Semantic Pruning for Robust Semi-Supervised Learning

2023-05-29 · CVPR 2023 1 · Yu Wang, Pengchong Qiao, Chang Liu, Guoli Song 외

Recent advances in robust semi-supervised learning (SSL) typically filter out-of-distribution (OOD) information at the sample level. We argue that an overlooked problem of robust SSL is its corrupted information on seman…

FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearning

2026-01-20 · Qian Feng, JiaHang Tu, Mintong Kang, Hanbin Zhao 외 arxiv

Incremental unlearning (IU) is critical for pre-trained models to comply with sequential data deletion requests, yet existing methods primarily suppress parameters or confuse knowledge without explicit constraints on bot…