Online Learning and Unlearning
We formalize the problem of online learning-unlearning, where a model is updated sequentially in an online setting while accommodating unlearning requests between updates. After a data point is unlearned, all subsequent outputs must be statistically indistinguishable from those of a model trained without that point. We present two online learner-unlearner (OLU) algorithms, both built upon online gradient descent (OGD). The first, passive OLU, leverages OGD's contractive property and injects noise when unlearning occurs, incurring no additional computation. The second, active OLU, uses an offline unlearning algorithm that shifts the model toward a solution excluding the deleted data. Under standard convexity and smoothness assumptions, both methods achieve regret bounds comparable to those of standard OGD, demonstrating that one can maintain competitive regret bounds while providing unlearning guarantees.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Mo' Memory, Mo' Problems: Stream-Native Machine Unlearning
Machine unlearning work assumes a static, i.i.d training environment that doesn't truly exist. Modern ML pipelines need to learn, unlearn, and predict continuously on production streams of data. We translate batch unlear…
Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models
This paper explores Machine Unlearning (MU), an emerging field that is gaining increased attention due to concerns about neural models unintentionally remembering personal or sensitive information. We present SeUL, a nov…
Computational EfficiencyLanguage ModellingMachine UnlearningMemorizationUnlearning for Federated Online Learning to Rank: A Reproducibility Study
This paper reports on findings from a comparative study on the effectiveness and efficiency of federated unlearning strategies within Federated Online Learning to Rank (FOLTR), with specific attention to systematically a…
Learning-To-RankUnlearning Graph Classifiers with Limited Data Resources
As the demand for user privacy grows, controlled data removal (machine unlearning) is becoming an important feature of machine learning models for data-sensitive Web applications such as social networks and recommender s…
Graph ClassificationMachine UnlearningRecommendation SystemsTowards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness
Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks …
Machine UnlearningManagement