paper-with-me

Papers

MrGuard: A Multilingual Reasoning Guardrail for Universal LLM Safety

2025-04-21 · Yahan Yang, Soham Dan, Shuo Li, Dan Roth, Insup Lee

Large Language Models (LLMs) are susceptible to adversarial attacks such as jailbreaking, which can elicit harmful or unsafe behaviors. This vulnerability is exacerbated in multilingual settings, where multilingual safety-aligned data is often limited. Thus, developing a guardrail capable of detecting and filtering unsafe content across diverse languages is critical for deploying LLMs in real-world applications. In this work, we introduce a multilingual guardrail with reasoning for prompt classification. Our method consists of: (1) synthetic multilingual data generation incorporating culturally and linguistically nuanced variants, (2) supervised fine-tuning, and (3) a curriculum-based Group Relative Policy Optimization (GRPO) framework that further improves performance. Experimental results demonstrate that our multilingual guardrail, MrGuard, consistently outperforms recent baselines across both in-domain and out-of-domain languages by more than 15%. We also evaluate MrGuard's robustness to multilingual variations, such as code-switching and low-resource language distractors in the prompt, and demonstrate that it preserves safety judgments under these challenging conditions. The multilingual reasoning capability of our guardrail enables it to generate explanations, which are particularly useful for understanding language-specific risks and ambiguities in multilingual content moderation.

📄 PDF Abstract BibTeX arXiv:2504.15241

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CREST: Universal Safety Guardrails Through Cluster-Guided Cross-Lingual Transfer

2025-12-02 · Lavish Bansal, Naman Mishra arxiv

Ensuring content safety in large language models (LLMs) is essential for their deployment in real-world applications. However, existing safety guardrails are predominantly tailored for high-resource languages, leaving a …

Cross-Lingual Transfer

ML-Bench&Guard: Policy-Grounded Multilingual Safety Benchmark and Guardrail for Large Language Models

2026-05-01 · Yunhan Zhao, Zhaorun Chen, Xingjun Ma, Yu-Gang Jiang 외 arxiv

As Large Language Models (LLMs) are increasingly deployed in cross-linguistic contexts, ensuring safety in diverse regulatory and cultural environments has become a critical challenge. However, existing multilingual benc…

Machine Translation

DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails

2025-02-07 · Yihe Deng, Yu Yang, Junkai Zhang, Wei Wang 외

The rapid advancement of large language models (LLMs) has increased the need for guardrail models to ensure responsible use, particularly in detecting unsafe and illegal content. While substantial safety data exist in En…

Reinforcement Learning (RL)Synthetic Data Generation

SEALGuard: Safeguarding the Multilingual Conversations in Southeast Asian Languages for LLM Software Systems

2025-07-11 · Wenliang Shan, Michael Fu, Rui Yang, Chakkrit Tantithamthavorn arxiv

Safety alignment is critical for LLM-powered systems. While recent LLM-powered guardrail approaches such as LlamaGuard achieve high detection accuracy of unsafe inputs written in English (e.g., ``How to create a bomb?'')…

Benchmarking LLM Guardrails in Handling Multilingual Toxicity

2024-10-29 · Yahan Yang, Soham Dan, Dan Roth, Insup Lee

With the ubiquity of Large Language Models (LLMs), guardrails have become crucial to detect and defend against toxic content. However, with the increasing pervasiveness of LLMs in multilingual scenarios, their effectiven…

Benchmarking