paper-with-me

Papers

LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models

2024-07-03 · Hayder Elesedy, Pedro M. Esperança, Silviu Vlad Oprea, Mete Ozay

Guardrails have emerged as an alternative to safety alignment for content moderation of large language models (LLMs). Existing model-based guardrails have not been designed for resource-constrained computational portable devices, such as mobile phones, more and more of which are running LLM-based applications locally. We introduce LoRA-Guard, a parameter-efficient guardrail adaptation method that relies on knowledge sharing between LLMs and guardrail models. LoRA-Guard extracts language features from the LLMs and adapts them for the content moderation task using low-rank adapters, while a dual-path design prevents any performance degradation on the generative task. We show that LoRA-Guard outperforms existing approaches with 100-1000x lower parameter overhead while maintaining accuracy, enabling on-device content moderation.

📄 PDF Abstract BibTeX arXiv:2407.02987

Code (0)

등록된 구현이 없습니다.

Tasks

Safety Alignment

Similar Papers 제목 키워드 기반

SEALGuard: Safeguarding the Multilingual Conversations in Southeast Asian Languages for LLM Software Systems

2025-07-11 · Wenliang Shan, Michael Fu, Rui Yang, Chakkrit Tantithamthavorn arxiv

Safety alignment is critical for LLM-powered systems. While recent LLM-powered guardrail approaches such as LlamaGuard achieve high detection accuracy of unsafe inputs written in English (e.g., ``How to create a bomb?'')…

OpenGuardrails: A Configurable, Unified, and Scalable Guardrails Platform for Large Language Models

2025-10-22 · Thomas Wang, Haowen Li arxiv

As large language models (LLMs) are increasingly integrated into real-world applications, ensuring their safety, robustness, and privacy compliance has become critical. We present OpenGuardrails, the first fully open-sou…

Text Generation

ExpGuard: LLM Content Moderation in Specialized Domains

2026-03-03 · Minseok Choi, Dongjin Kim, Seungbin Yang, Subin Kim 외 arxiv

With the growing deployment of large language models (LLMs) in real-world applications, establishing robust safety guardrails to moderate their inputs and outputs has become essential to ensure adherence to safety polici…

FreoStream:Enhancing Stream Guardrails via Future-Aware Reasoning and Safety-Aligned Optimization

2026-06-11 · Jianwei Wang, Guoyang Shen, Yanhong Wu, Haoran Li 외 arxiv

Stream guardrails enable token-level safety detection before full responses are generated. However, they often make overly conservative judgements and block those sensitive but safe tokens, which is known as over-refusal…

Building Effective Safety Guardrails in AI Education Tools

2025-08-07 · Hannah-Beth Clark, Laura Benton, Emma Searle, Margaux Dowland 외 arxiv

There has been rapid development in generative AI tools across the education sector, which in turn is leading to increased adoption by teachers. However, this raises concerns regarding the safety and age-appropriateness …

Prompt Engineering