paper-with-me

홈 › Papers

Forget Many, Forget Right: Scalable and Precise Concept Unlearning in Diffusion Models

2026-01-06 · Kaiyuan Deng, Gen Li, Yang Xiao, Bo Hui, Xiaolong Ma arxiv

Text-to-image diffusion models have achieved remarkable progress, yet their use raises copyright and misuse concerns, prompting research into machine unlearning. However, extending multi-concept unlearning to large-scale scenarios remains difficult due to three challenges: (i) conflicting weight updates that hinder unlearning or degrade generation; (ii) imprecise mechanisms that cause collateral damage to similar content; and (iii) reliance on additional data or modules, creating scalability bottlenecks. To address these, we propose Scalable-Precise Concept Unlearning (ScaPre), a unified framework tailored for large-scale unlearning. ScaPre introduces a conflict-aware stable design, integrating spectral trace regularization and geometry alignment to stabilize optimization, suppress conflicts, and preserve global structure. Furthermore, an Informax Decoupler identifies concept-relevant parameters and adaptively reweights updates, strictly confining unlearning to the target subspace. ScaPre yields an efficient closed-form solution without requiring auxiliary data or sub-models. Comprehensive experiments on objects, styles, and explicit content demonstrate that ScaPre effectively removes target concepts while maintaining generation quality. It forgets up to $\times \mathbf{5}$ more concepts than the best baseline within acceptable quality limits, achieving state-of-the-art precision and efficiency for large-scale unlearning. Code is available at https://github.com/kaiyuan02415/scapre

📄 PDF Abstract BibTeX arXiv:2601.06162

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Machine Unlearning in Forgettability Sequence

2024-10-09 · Junjie Chen, Qian Chen, Jian Lou, XiaoYu Zhang 외

Machine unlearning (MU) is becoming a promising paradigm to achieve the "right to be forgotten", where the training trace of any chosen data points could be eliminated, while maintaining the model utility on general test…

Machine Unlearning

Digital Forgetting in Large Language Models: A Survey of Unlearning Methods

2024-04-02 · Alberto Blanco-Justicia, Najeeb Jebreel, Benet Manzanares, David Sánchez 외

The objective of digital forgetting is, given a model with undesirable knowledge or behavior, obtain a new model where the detected issues are no longer present. The motivations for forgetting include privacy protection,…

Machine UnlearningSurvey

LEGATO: Good Identity Unlearning Is Continuous

2026-01-07 · Qiang Chen, Chun-Wun Cheng, Xiu Su, Hongyan Xu 외 arxiv

Machine unlearning has become a crucial role in enabling generative models trained on large datasets to remove sensitive, private, or copyright-protected data. However, existing machine unlearning methods face three chal…

Forgetting Formulas and Signature Elements in Epistemic States

2021-08-19 · A. Becker, G. Kern-Isberner, K. Sauerwald, C. Beierle

Delgrande's knowledge level account of forgetting provides a general approach to forgetting syntax elements from sets of formulas with links to many other forgetting operations, in particular, to Boole's variable elimina…

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models

2024-07-02 · Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng, Qingbin Liu 외

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM …

General Knowledge