paper-with-me

Papers

Prompt Fencing: A Cryptographic Approach to Establishing Security Boundaries in Large Language Model Prompts

2025-11-24 · Steven Peh arxiv

Large Language Models (LLMs) remain vulnerable to prompt injection attacks, representing the most significant security threat in production deployments. We present Prompt Fencing, a novel architectural approach that applies cryptographic authentication and data architecture principles to establish explicit security boundaries within LLM prompts. Our approach decorates prompt segments with cryptographically signed metadata including trust ratings and content types, enabling LLMs to distinguish between trusted instructions and untrusted content. While current LLMs lack native fence awareness, we demonstrate that simulated awareness through prompt instructions achieved complete prevention of injection attacks in our experiments, reducing success rates from 86.7% (260/300 successful attacks) to 0% (0/300 successful attacks) across 300 test cases with two leading LLM providers. We implement a proof-of-concept fence generation and verification pipeline with a total overhead of 0.224 seconds (0.130s for fence generation, 0.094s for validation) across 100 samples. Our approach is platform-agnostic and can be incrementally deployed as a security layer above existing LLM infrastructure, with the expectation that future models will be trained with native fence awareness for optimal security.

📄 PDF Abstract BibTeX arXiv:2511.19727

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Authenticated Workflows: A Systems Approach to Protecting Agentic AI

2026-02-11 · Mohan Rajagopalan, Vinay Rao arxiv

Agentic AI systems automate enterprise workflows but existing defenses--guardrails, semantic filters--are probabilistic and routinely bypassed. We introduce authenticated workflows, the first complete trust layer for ent…

CIPHER: Cryptographic Insecurity Profiling via Hybrid Evaluation of Responses

2026-02-01 · Max Manolov, Tony Gao, Siddharth Shukla, Cheng-Ting Chou 외 arxiv

Large language models (LLMs) are increasingly used to assist developers with code, yet their implementations of cryptographic functionality often contain exploitable flaws. Minor design choices (e.g., static initializati…

A2AS: Agentic AI Runtime Security and Self-Defense

2025-10-08 · Eugene Neelou, Ivan Novikov, Max Moroz, Om Narayan 외 arxiv

The A2AS framework is introduced as a security layer for AI agents and LLM-powered applications, similar to how HTTPS secures HTTP. A2AS enforces certified behavior, activates model self-defense, and ensures context wind…

AITH: A Post-Quantum Continuous Delegation Protocol for Human-AI Trust Establishment

2026-04-09 · Zhaoliang Chen arxiv

The rapid deployment of AI agents acting autonomously on behalf of human principals has outpaced the development of cryptographic protocols for establishing, bounding, and revoking human-AI trust relationships. Existing …

Protecting Context and Prompts: Deterministic Security for Non-Deterministic AI

2026-02-11 · Mohan Rajagopalan, Vinay Rao arxiv

Large Language Model (LLM) applications are vulnerable to prompt injection and context manipulation attacks that traditional security models cannot prevent. We introduce two novel primitives--authenticated prompts and au…