paper-with-me

홈 › Papers

Multimodal Prompt Injection Attacks: Risks and Defenses for Modern LLMs

2025-09-07 · Andrew Yeo, Daeseon Choi arxiv

Large Language Models (LLMs) have seen rapid adoption in recent years, with industries increasingly relying on them to maintain a competitive advantage. These models excel at interpreting user instructions and generating human-like responses, leading to their integration across diverse domains, including consulting and information retrieval. However, their widespread deployment also introduces substantial security risks, most notably in the form of prompt injection and jailbreak attacks. To systematically evaluate LLM vulnerabilities -- particularly to external prompt injection -- we conducted a series of experiments on eight commercial models. Each model was tested without supplementary sanitization, relying solely on its built-in safeguards. The results exposed exploitable weaknesses and emphasized the need for stronger security measures. Four categories of attacks were examined: direct injection, indirect (external) injection, image-based injection, and prompt leakage. Comparative analysis indicated that Claude 3 demonstrated relatively greater robustness; nevertheless, empirical findings confirm that additional defenses, such as input normalization, remain necessary to achieve reliable protection.

📄 PDF Abstract BibTeX arXiv:2509.05883

Code (0)

등록된 구현이 없습니다.

Tasks

Information Retrieval

Similar Papers 제목 키워드 기반

Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents

2025-02-27 · Qiusi Zhan, Richard Fang, Henil Shalin Panchal, Daniel Kang

Large Language Model (LLM) agents exhibit remarkable performance across diverse applications by using external tools to interact with environments. However, integrating external tools introduces security risks, such as i…

Language ModelingLanguage ModellingLarge Language Model

PIArena: A Platform for Prompt Injection Evaluation

2026-04-09 · Runpeng Geng, Chenlong Yin, Yanting Wang, Ying Chen 외 arxiv

Prompt injection attacks pose serious security risks across a wide range of real-world applications. While receiving increasing attention, the community faces a critical gap: the lack of a unified platform for prompt inj…

VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents

2025-06-03 · Tri Cao, Bennett Lim, Yue Liu, Yuan Sui 외

Computer-Use Agents (CUAs) with full system access enable powerful task automation but pose significant security and privacy risks due to their ability to manipulate files, access user data, and execute arbitrary command…

Formalizing and Benchmarking Prompt Injection Attacks and Defenses

2023-10-19 · Yupei Liu, Yuqi Jia, Runpeng Geng, Jinyuan Jia 외

A prompt injection attack aims to inject malicious instruction/data into the input of an LLM-Integrated Application such that it produces results as an attacker desires. Existing works are limited to case studies. As a r…

Benchmarking

PI-Hunter: Automated Red-Teaming for Exposing and Localizing Prompt Injections

2026-06-10 · Pengfei He, Lesly Miculicich, Vishesh Sharma, Ash Fox 외 arxiv

Large Language Models (LLMs) are rapidly evolving into agentic systems that interact with external tools and environments, introducing new security risks such as indirect prompt injection attacks through untrusted extern…