paper-with-me

홈 › Papers

Static and Sequential Malicious Attacks in the Context of Selective Forgetting

2023-09-21 · NeurIPS 2023 11

With the growing demand for the right to be forgotten, there is an increasing need for machine learning models to forget sensitive data and its impact. To address this, the paradigm of selective forgetting (a.k.a machine unlearning) has been extensively studied, which aims to remove the impact of requested data from a well-trained model without retraining from scratch. Despite its significant success, limited attention has been given to the security vulnerabilities of the unlearning system concerning malicious data update requests. Motivated by this, in this paper, we explore the possibility and feasibility of malicious data update requests during the unlearning process. Specifically, we first propose a new class of malicious selective forgetting attacks, which involves a static scenario where all the malicious data update requests are provided by the adversary at once. Additionally, considering the sequential setting where the data update requests arrive sequentially, we also design a novel framework for sequential forgetting attacks, which is formulated as a stochastic optimal control problem. We also propose novel optimization algorithms that can find the effective malicious data update requests. We perform theoretical analyses for the proposed selective forgetting attacks, and extensive experimental results validate the effectiveness of our proposed selective forgetting attacks. The source code is available in the supplementary material.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Exploring Fairness in Educational Data Mining in the Context of the Right to be Forgotten

2024-05-27 · Wei Qian, Aobo Chen, Chenxu Zhao, Yangyi Li 외

In education data mining (EDM) communities, machine learning has achieved remarkable success in discovering patterns and structures to tackle educational challenges. Notably, fairness and algorithmic bias have gained att…

FairnessMachine Unlearning

TrojanPuzzle: Covertly Poisoning Code-Suggestion Models

2023-01-06 · Hojjat Aghakhani, Wei Dai, Andre Manoel, Xavier Fernandes 외

With tools like GitHub Copilot, automatic code suggestion is no longer a dream in software engineering. These tools, based on large language models, are typically trained on massive corpora of code mined from unvetted pu…

Data Poisoning

ScriptNet: Neural Static Analysis for Malicious JavaScript Detection

2019-04-01 · Jack W. Stokes, Rakshit Agrawal, Geoff McDonald, Matthew Hausknecht

Malicious scripts are an important computer infection threat vector in the wild. For web-scale processing, static analysis offers substantial computing efficiencies. We propose the ScriptNet system for neural malicious J…

Enhancing GraphQL Security by Detecting Malicious Queries Using Large Language Models, Sentence Transformers, and Convolutional Neural Networks

2025-08-14 · Irash Perera, Hiranya Abeyrathne, Sanjeewa Malalgoda, Arshardh Ifthikar arxiv

GraphQL's flexibility, while beneficial for efficient data fetching, introduces unique security vulnerabilities that traditional API security mechanisms often fail to address. Malicious GraphQL queries can exploit the la…

Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learning

2024-01-16 · Yu Jiang, Jiyuan Shen, Ziyao Liu, Chee Wei Tan 외

Federated learning (FL) is vulnerable to poisoning attacks, where malicious clients manipulate their updates to affect the global model. Although various methods exist for detecting those clients in FL, identifying malic…

Federated Learning