paper-with-me

Papers

PolicyShiftGuard: Benchmarking and Improving Policy-Adaptive Image Guardrails

2026-07-07 · Mingyang Song, Luxin Xu, Haoyu Sun, Minzhou Pan, Yu Cheng, Bo Li arxiv

Image guardrails are typically trained and evaluated under a fixed safety policy, implicitly treating safety as an intrinsic property of an image. Real deployments are different: the same image may be allowed in one product, restricted in another, and newly disallowed when a policy boundary changes. We study policy-adaptive image guardrailing, where a model must decide whether an image violates the currently supplied policy and generalize to held-out policy definitions. We introduce PolicyShiftBench, a comprehensive benchmark with 2,000 policy-discriminative instances over 265 images, where each image is paired with 7.55 policy-conditioned prompts on average to test whether models adapt to the active policy rather than relying on image-level safety priors. We then propose PolicyShiftGuard, a compact policy-conditioned guardrail trained with a two-stage training recipe that combines Randomized Policy SFT (RP-SFT) with Boundary-Pair Policy Adaptation (BP-Adapt). BP-Adapt trains matched prompts for the same image and risk category using standard label supervision and a pairwise comparison loss that separates blocking policies from passing policies. Experiments show that existing VLMs and specialized guardrails remain brittle under policy shifts, while PolicyShiftGuard substantially improves policy-sensitive performance. The 7B model achieves SOTA performance of 76.9 Avg. F1 and 72.1 Avg. PSS on PolicyShiftBench, transfers well to UnSafeBench and SafeEditBench, and improves the latency-performance trade-off with a concise output format. Ablations confirm that matched pass/block boundary pairs are essential for stable policy adaptation.

📄 PDF Abstract BibTeX arXiv:2607.05910

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Policy-Adaptive Image Guardrail: Benchmark and Method

2026-03-01 · Caiyong Piao, Zhiyuan Yan, Haoming Xu, Yunzhen Zhao 외 arxiv

Accurate rejection of sensitive or harmful visual content, i.e., harmful image guardrail, is critical in many application scenarios. This task must continuously adapt to the evolving safety policies and content across va…

Reinforcement LearningGeneral Knowledge

Benchmarking LLM Guardrails in Handling Multilingual Toxicity

2024-10-29 · Yahan Yang, Soham Dan, Dan Roth, Insup Lee

With the ubiquity of Large Language Models (LLMs), guardrails have become crucial to detect and defend against toxic content. However, with the increasing pervasiveness of LLMs in multilingual scenarios, their effectiven…

Benchmarking

SafePyramid: A Hierarchical Benchmark for In-context Policy Guardrailing

2026-06-29 · Jiacheng Zhang, Haoyu He, Sen Zhang, Shen Wang 외 arxiv

In real-world applications, guardrails are often expected to identify unsafe user-model interactions according to application-specific safety policies, rather than relying on predefined risk taxonomies. In this work, we …

CS-Guard: Benchmarking LLM Guardrails for Code Generation Security

2026-09-09 · Jinyang Li, Mingyu Guo, Hung X. Nguyen arxiv

Large language models (LLMs) have been ex- ploited to generate malware, but the effective- ness of guardrails for code generation secu- rity remains unclear. We introduce CS-Guard, the first benchmark to systematically e…

Text-to-Code GenerationCode TranslationCode Completion

ConsisGuard: Aligning Safety Deliberation with Policy Enforcement in LLM Guardrails

2026-05-29 · Yan Wang, Zhixuan Chu, Zihao Xue, Zhen Bi 외 arxiv

Reasoning-based LLM guardrails improve safety moderation by generating explicit rationales before issuing final decisions. However, their rationales do not always lead to faithful enforcement: a model may recognize a har…