paper-with-me

Papers

xJailbreak: Representation Space Guided Reinforcement Learning for Interpretable LLM Jailbreaking

2025-01-28 · Sunbowen Lee, Shiwen Ni, Chi Wei, Shuaimin Li, Liyang Fan, Ahmadreza Argha, Hamid Alinejad-Rokny, Ruifeng Xu, Yicheng Gong, Min Yang

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without accessing the model's internal parameters, a phenomenon known as black-box jailbreak. Existing heuristic black-box attack methods, such as genetic algorithms, suffer from limited effectiveness due to their inherent randomness, while recent reinforcement learning (RL) based methods often lack robust and informative reward signals. To address these challenges, we propose a novel black-box jailbreak method leveraging RL, which optimizes prompt generation by analyzing the embedding proximity between benign and malicious prompts. This approach ensures that the rewritten prompts closely align with the intent of the original prompts while enhancing the attack's effectiveness. Furthermore, we introduce a comprehensive jailbreak evaluation framework incorporating keywords, intent matching, and answer validation to provide a more rigorous and holistic assessment of jailbreak success. Experimental results show the superiority of our approach, achieving state-of-the-art (SOTA) performance on several prominent open and closed-source LLMs, including Qwen2.5-7B-Instruct, Llama3.1-8B-Instruct, and GPT-4o-0806. Our method sets a new benchmark in jailbreak attack effectiveness, highlighting potential vulnerabilities in LLMs. The codebase for this work is available at https://github.com/Aegis1863/xJailbreak.

📄 PDF Abstract BibTeX arXiv:2501.16727

Code (1)

aegis1863/xjailbreak 공식 구현 pytorch

Tasks

Reinforcement Learning (RL)Safety Alignment

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

A Reinforcement Learning Approach to Domain-Knowledge Inclusion Using Grammar Guided Symbolic Regression

2022-02-09 · Laure Crochepierre, Lydia Boudjeloud-Assala, Vincent Barbesant

In recent years, symbolic regression has been of wide interest to provide an interpretable symbolic representation of potentially large data relationships. Initially circled to genetic algorithms, symbolic regression met…

regressionreinforcement-learningReinforcement Learning (RL)Symbolic Regression

Programmatic Reinforcement Learning without Oracles

2021-09-29 · ICLR 2022 4 · Wenjie Qiu, He Zhu

Deep reinforcement learning (RL) has led to encouraging successes in many challenging control tasks. However, a deep RL model lacks interpretability due to the difficulty of identifying how the model's control logic rela…

Bilevel OptimizationDeep Reinforcement LearningPolicy Gradient Methodsreinforcement-learning+2

Semantic-Guided RL for Interpretable Feature Engineering

2024-10-03 · Mohamed Bouadi, Arta Alavi, Salima Benbernou, Mourad Ouziri

The quality of Machine Learning (ML) models strongly depends on the input data, as such generating high-quality features is often required to improve the predictive accuracy. This process is referred to as Feature Engine…

Automated Feature EngineeringDeep Reinforcement LearningFeature EngineeringKnowledge Graphs

Missing No More: Dictionary-Guided Cross-Modal Image Fusion under Missing Infrared

2026-03-09 · Yafei Zhang, Meng Ma, Huafeng Li, Yu Liu arxiv

Infrared-visible (IR-VIS) image fusion is vital for perception and security, yet most methods rely on the availability of both modalities during training and inference. When the infrared modality is absent, pixel-space g…

Representation Learning

Semantics-Guided Representation Learning with Applications to Visual Synthesis

2020-10-21 · Jia-Wei Yan, Ci-Siang Lin, Fu-En Yang, Yu-Jhe Li 외

Learning interpretable and interpolatable latent representations has been an emerging research direction, allowing researchers to understand and utilize the derived latent space for further applications such as visual sy…

Representation LearningTriplet