paper-with-me

Papers

Open Problems in Machine Unlearning for AI Safety

2025-01-09 · Fazl Barez, Tingchen Fu, Ameya Prabhu, Stephen Casper, Amartya Sanyal, Adel Bibi, Aidan O'Gara, Robert Kirk, Ben Bucknall, Tim Fist, Luke Ong, Philip Torr, Kwok-Yan Lam, Robert Trager, David Krueger, Sören Mindermann, José Hernandez-Orallo, Mor Geva, Yarin Gal

As AI systems become more capable, widely deployed, and increasingly autonomous in critical areas such as cybersecurity, biological research, and healthcare, ensuring their safety and alignment with human values is paramount. Machine unlearning -- the ability to selectively forget or suppress specific types of knowledge -- has shown promise for privacy and data removal tasks, which has been the primary focus of existing research. More recently, its potential application to AI safety has gained attention. In this paper, we identify key limitations that prevent unlearning from serving as a comprehensive solution for AI safety, particularly in managing dual-use knowledge in sensitive domains like cybersecurity and chemical, biological, radiological, and nuclear (CBRN) safety. In these contexts, information can be both beneficial and harmful, and models may combine seemingly harmless information for harmful purposes -- unlearning this information could strongly affect beneficial uses. We provide an overview of inherent constraints and open problems, including the broader side effects of unlearning dangerous knowledge, as well as previously unexplored tensions between unlearning and existing safety mechanisms. Finally, we investigate challenges related to evaluation, robustness, and the preservation of safety features during unlearning. By mapping these limitations and open challenges, we aim to guide future research toward realistic applications of unlearning within a broader AI safety framework, acknowledging its limitations and highlighting areas where alternative approaches may be required.

📄 PDF Abstract BibTeX arXiv:2501.04952

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Unlearning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

An Unlearning Framework for Continual Learning

2025-09-22 · Sayanta Adhikari, Vishnuprasadh Kumaravelu, P. K. Srijith arxiv

Growing concerns surrounding AI safety and data privacy have driven the development of Machine Unlearning as a potential solution. However, current machine unlearning algorithms are designed to complement the offline tra…

Continual Learning

Machine Unlearning: A Comprehensive Survey

2024-05-13 · Weiqi Wang, Zhiyi Tian, Chenhan Zhang, Shui Yu

As the right to be forgotten has been legislated worldwide, many studies attempt to design unlearning mechanisms to protect users' privacy when they want to leave machine learning service platforms. Specifically, machine…

Machine UnlearningSurvey

Machine Unlearning: Solutions and Challenges

2023-08-14 · Jie Xu, Zihan Wu, Cong Wang, Xiaohua Jia

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unl…

Machine Unlearning

Verification of Machine Unlearning is Fragile

2024-08-01 · Binchi Zhang, Zihan Chen, Cong Shen, Jundong Li

As privacy concerns escalate in the realm of machine learning, data owners now have the option to utilize machine unlearning to remove their data from machine learning models, following recent legislation. To enhance tra…

Machine Unlearning

OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics

2025-06-14 · Vineeth Dorna, Anmol Mekala, Wenlong Zhao, Andrew McCallum 외

Robust unlearning is crucial for safely deploying large language models (LLMs) in environments where data privacy, model safety, and regulatory compliance must be ensured. Yet the task is inherently challenging, partly d…

Benchmarking