paper-with-me

Papers

A Unified Framework for Continual Learning and Unlearning

2024-08-21 · Romit Chatterjee, Vikram Chundawat, Ayush Tarun, Ankur Mali, Murari Mandal

Continual learning and machine unlearning are crucial challenges in machine learning, typically addressed separately. Continual learning focuses on adapting to new knowledge while preserving past information, whereas unlearning involves selectively forgetting specific subsets of data. In this paper, we introduce a new framework that jointly tackles both tasks by leveraging controlled knowledge distillation. Our approach enables efficient learning with minimal forgetting and effective targeted unlearning. By incorporating a fixed memory buffer, the system supports learning new concepts while retaining prior knowledge. The distillation process is carefully managed to ensure a balance between acquiring new information and forgetting specific data as needed. Experimental results on benchmark datasets show that our method matches or exceeds the performance of existing approaches in both continual learning and machine unlearning. This unified framework is the first to address both challenges simultaneously, paving the way for adaptable models capable of dynamic learning and forgetting while maintaining strong overall performance. Source code: \textcolor{blue}{https://respailab.github.io/CLMUL}

📄 PDF Abstract BibTeX arXiv:2408.11374

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningKnowledge DistillationMachine Unlearning

Similar Papers 제목 키워드 기반

A Unified Gradient-based Framework for Task-agnostic Continual Learning-Unlearning

2025-05-21 · Zhehao Huang, Xinwen Cheng, Jie Zhang, JingHao Zheng 외

Recent advancements in deep models have highlighted the need for intelligent systems that combine continual learning (CL) for knowledge acquisition with machine unlearning (MU) for data removal, forming the Continual Lea…

Continual LearningIncremental LearningMachine Unlearning

BID-LoRA: A Parameter-Efficient Framework for Continual Learning and Unlearning

2026-04-14 · Jagadeesh Rachapudi, Ritali Vatsi, Praful Hambarde, Amit Shukla arxiv

Recent advances in deep learning underscore the need for systems that can not only acquire new knowledge through Continual Learning (CL) but also remove outdated, sensitive, or private information through Machine Unlearn…

Continual LearningFace Recognition

FIT to Forget: Robust Continual Unlearning for Large Language Models

2026-01-29 · Xiaoyu Xu, Minxin Du, Kun Fang, Yaxin Xiao 외 arxiv

While large language models (LLMs) exhibit remarkable capabilities, they increasingly face demands to unlearn memorized privacy-sensitive, copyrighted, or harmful content. Existing unlearning methods primarily focus on \…

An Unlearning Framework for Continual Learning

2025-09-22 · Sayanta Adhikari, Vishnuprasadh Kumaravelu, P. K. Srijith arxiv

Growing concerns surrounding AI safety and data privacy have driven the development of Machine Unlearning as a potential solution. However, current machine unlearning algorithms are designed to complement the offline tra…

Continual Learning

ICCU: In-Context Continual Unlearning via Pattern-Induced Refusal Rules

2026-05-26 · Ruihao Pan, Suhang Wang arxiv

Machine unlearning aims to remove the influence of specific data from trained language models. In real-world deployments, unlearning requests often arrive sequentially, which challenges existing fine-tuning-based methods…