paper-with-me

Papers

Unlearning Graph Classifiers with Limited Data Resources

2022-11-06 · Chao Pan, Eli Chien, Olgica Milenkovic

As the demand for user privacy grows, controlled data removal (machine unlearning) is becoming an important feature of machine learning models for data-sensitive Web applications such as social networks and recommender systems. Nevertheless, at this point it is still largely unknown how to perform efficient machine unlearning of graph neural networks (GNNs); this is especially the case when the number of training samples is small, in which case unlearning can seriously compromise the performance of the model. To address this issue, we initiate the study of unlearning the Graph Scattering Transform (GST), a mathematical framework that is efficient, provably stable under feature or graph topology perturbations, and offers graph classification performance comparable to that of GNNs. Our main contribution is the first known nonlinear approximate graph unlearning method based on GSTs. Our second contribution is a theoretical analysis of the computational complexity of the proposed unlearning mechanism, which is hard to replicate for deep neural networks. Our third contribution are extensive simulation results which show that, compared to complete retraining of GNNs after each removal request, the new GST-based approach offers, on average, a 10.38x speed-up and leads to a 2.6% increase in test accuracy during unlearning of 90 out of 100 training graphs from the IMDB dataset (10% training ratio). Our implementation is available online at https://doi.org/10.5281/zenodo.7613150.

📄 PDF Abstract BibTeX arXiv:2211.03216

Code (1)

thupchnsky/sgc_unlearn pytorch

Tasks

Graph ClassificationMachine UnlearningRecommendation Systems

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Node-level Contrastive Unlearning on Graph Neural Networks

2025-03-04 · Hong kyu Lee, Qiuchen Zhang, Carl Yang, Li Xiong

Graph unlearning aims to remove a subset of graph entities (i.e. nodes and edges) from a graph neural network (GNN) trained on the graph. Unlike machine unlearning for models trained on Euclidean-structured data, effecti…

Graph Neural Networkgraph partitioningMachine Unlearning

iShumei-Chinchunmei at SemEval-2025 Task 4: A balanced forgetting and retention multi-task framework using effective unlearning loss

2025-07-22 · Yujian Sun, Tian Li arxiv

As the Large Language Model (LLM) gains widespread adoption, increasing attention has been given to the challenge of making LLM forget non-compliant data memorized during its pre-training. Machine Unlearning focuses on e…

Machine Unlearning Fails to Remove Data Poisoning Attacks

2024-06-25 · Martin Pawelczyk, Jimmy Z. Di, Yiwei Lu, Ayush Sekhari 외

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application…

Data PoisoningMachine Unlearning

Large Language Model Unlearning

2023-10-14 · Yuanshun Yao, Xiaojun Xu, Yang Liu

We study how to perform unlearning, i.e. forgetting undesirable misbehaviors, on large language models (LLMs). We show at least three scenarios of aligning LLMs with human preferences can benefit from unlearning: (1) rem…

Language ModelingLanguage ModellingLarge Language Modelmodel+1

A Survey of Graph Unlearning

2023-08-23 · Anwar Said, Yuying Zhao, Tyler Derr, Mudassir Shabbir 외

Graph unlearning emerges as a crucial advancement in the pursuit of responsible AI, providing the means to remove sensitive data traces from trained models, thereby upholding the right to be forgotten. It is evident that…

Privacy PreservingRecommendation SystemsSurvey