paper-with-me

Papers

Evolving Security in LLMs: A Study of Jailbreak Attacks and Defenses

2025-04-02 · Zhengchun Shang, Wenlan Wei

Large Language Models (LLMs) are increasingly popular, powering a wide range of applications. Their widespread use has sparked concerns, especially through jailbreak attacks that bypass safety measures to produce harmful content. In this paper, we present a comprehensive security analysis of large language models (LLMs), addressing critical research questions on the evolution and determinants of model safety. Specifically, we begin by identifying the most effective techniques for detecting jailbreak attacks. Next, we investigate whether newer versions of LLMs offer improved security compared to their predecessors. We also assess the impact of model size on overall security and explore the potential benefits of integrating multiple defense strategies to enhance model robustness. Our study evaluates both open-source models (e.g., LLaMA and Mistral) and closed-source systems (e.g., GPT-4) by employing four state-of-the-art attack techniques and assessing the efficacy of three new defensive approaches.

📄 PDF Abstract BibTeX arXiv:2504.02080

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

NeuroBreak: Unveil Internal Jailbreak Mechanisms in Large Language Models

2025-09-04 · Chuhan Zhang, Ye Zhang, Bowen Shi, Yuyou Gan 외 arxiv

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to byp…

POEX: Understanding and Mitigating Policy Executable Jailbreak Attacks against Embodied AI

2024-12-21 · Xuancun Lu, Zhengxian Huang, Xinfeng Li, Xiaoyu Ji 외

Embodied AI systems are rapidly evolving due to the integration of LLMs as planning modules, which transform complex instructions into executable policies. However, LLMs are vulnerable to jailbreak attacks, which can gen…

LLM JailbreakRed Teaming

Exploring Jailbreak Attacks on LLMs through Intent Concealment and Diversion

2025-05-20 · Tiehan Cui, Yanxu Mao, Peipei Liu, Congying Liu 외

Although large language models (LLMs) have achieved remarkable advancements, their security remains a pressing concern. One major threat is jailbreak attacks, where adversarial prompts bypass model safeguards to generate…

Question AnsweringText Generation

Poisoned LangChain: Jailbreak LLMs by LangChain

2024-06-26 · Ziqiu Wang, Jun Liu, Shengkai Zhang, Yang Yang

With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulner…

RAGRetrievalRetrieval-augmented Generation

EasyJailbreak: A Unified Framework for Jailbreaking Large Language Models

2024-03-18 · Weikang Zhou, Xiao Wang, Limao Xiong, Han Xia 외

Jailbreak attacks are crucial for identifying and mitigating the security vulnerabilities of Large Language Models (LLMs). They are designed to bypass safeguards and elicit prohibited outputs. However, due to significant…