paper-with-me

Papers

Guardrail Baselines for Unlearning in LLMs

2024-03-05 · Pratiksha Thaker, Yash Maurya, Shengyuan Hu, Zhiwei Steven Wu, Virginia Smith

Recent work has demonstrated that finetuning is a promising approach to 'unlearn' concepts from large language models. However, finetuning can be expensive, as it requires both generating a set of examples and running iterations of finetuning to update the model. In this work, we show that simple guardrail-based approaches such as prompting and filtering can achieve unlearning results comparable to finetuning. We recommend that researchers investigate these lightweight baselines when evaluating the performance of more computationally intensive finetuning methods. While we do not claim that methods such as prompting or filtering are universal solutions to the problem of unlearning, our work suggests the need for evaluation metrics that can better separate the power of guardrails vs. finetuning, and highlights scenarios where guardrails expose possible unintended behavior in existing metrics and benchmarks.

📄 PDF Abstract BibTeX arXiv:2403.03329

Code (2)

pratiksha/guardrail-baselines 공식 구현
zikuicai/aegisllm pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

SAEs $\textit{Can}$ Improve Unlearning: Dynamic Sparse Autoencoder Guardrails for Precision Unlearning in LLMs

2025-04-11 · Aashiq Muhamed, Jacopo Bonato, Mona Diab, Virginia Smith

Machine unlearning is a promising approach to improve LLM safety by removing unwanted knowledge from the model. However, prevailing gradient-based unlearning methods suffer from issues such as high computational costs, h…

Computational Efficiencyfeature selectionMachine Unlearning

Editing as Unlearning: Are Knowledge Editing Methods Strong Baselines for Large Language Model Unlearning?

2025-05-26 · Zexi Li, Xiangzhu Wang, William F. Shen, Meghdad Kurmanji 외

Large language Model (LLM) unlearning, i.e., selectively removing information from LLMs, is vital for responsible model deployment. Differently, LLM knowledge editing aims to modify LLM knowledge instead of removing it. …

In-Context Learningknowledge editingLanguage ModelingLanguage Modelling+1

Jailbreaking Large Language Models Against Moderation Guardrails via Cipher Characters

2024-05-30 · Haibo Jin, Andy Zhou, Joe D. Menke, Haohan Wang

Large Language Models (LLMs) are typically harmless but remain vulnerable to carefully crafted prompts known as ``jailbreaks'', which can bypass protective measures and induce harmful behavior. Recent advancements in LLM…

Red Teaming

ThinkGuard: Deliberative Slow Thinking Leads to Cautious Guardrails

2025-02-19 · Xiaofei Wen, Wenxuan Zhou, Wenjie Jacky Mo, Muhao Chen

Ensuring the safety of large language models (LLMs) is critical as they are deployed in real-world applications. Existing guardrails rely on rule-based filtering or single-pass classification, limiting their ability to h…

Computational EfficiencyPass Classification

Soft Token Attacks Cannot Reliably Audit Unlearning in Large Language Models

2025-02-20 · Haokun Chen, Sebastian Szyller, Weilin Xu, Nageen Himayat

Large language models (LLMs) have become increasingly popular. Their emergent capabilities can be attributed to their massive training datasets. However, these datasets often contain undesirable or inappropriate content,…

Machine Unlearning