paper-with-me

홈 › Papers

Security awareness in LLM agents: the NDAI zone case

2026-03-19 · Enrico Bottazzi, Pia Park arxiv

NDAI zones let inventor and investor agents negotiate inside a Trusted Execution Environment (TEE) where any disclosed information is deleted if no deal is reached. This makes full IP disclosure the rational strategy for the inventor's agent. Leveraging this infrastructure, however, requires agents to distinguish a secure environment from an insecure one, a capability LLM agents lack natively, since they can rely only on evidence passed through the context window to form awareness of their execution environment. We ask: How do different LLM models weight various forms of evidence when forming awareness of the security of their execution environment? Using an NDAI-style negotiation task across 10 language models and various evidence scenarios, we find a clear asymmetry: a failing attestation universally suppresses disclosure across all models, whereas a passing attestation produces highly heterogeneous responses: some models increase disclosure, others are unaffected, and a few paradoxically reduce it. This reveals that current LLM models can reliably detect danger signals but cannot reliably verify safety, the very capability required for privacy-preserving agentic protocols such as NDAI zones. Bridging this gap, possibly through interpretability analysis, targeted fine-tuning, or improved evidence architectures, remains the central open challenge for deploying agents that calibrate information sharing to actual evidence quality.

📄 PDF Abstract BibTeX arXiv:2603.19011

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Dynamic Population Model of Strategic Interaction and Migration under Epidemic Risk

2021-09-07 · Ezzat Elokda, Saverio Bolognani, Ashish R. Hota

In this paper, we show how a dynamic population game can model the strategic interaction and migration decisions made by a large population of agents in response to epidemic prevalence. Specifically, we consider a modifi…

Argus: Smartphone-enabled Human Cooperation via Multi-Agent Reinforcement Learning for Disaster Situational Awareness

2019-04-29 · Vidyasagar Sadhu, Gabriel Salles-Loustau, Dario Pompili, Saman Zonouz 외

Argus exploits a Multi-Agent Reinforcement Learning (MARL) framework to create a 3D mapping of the disaster scene using agents present around the incident zone to facilitate the rescue operations. The agents can be both …

Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Poster: ClawdGo: Endogenous Security Awareness Training for Autonomous AI Agents

2026-04-27 · Jiaqi Li, Yang Zhao, Bin Sun, Yang Yu 외 arxiv

Autonomous AI agents deployed on platforms such as OpenClaw face prompt injection, memory poisoning, supply-chain attacks, and social engineering, yet existing defences address only the platform perimeter, leaving the ag…

When Developer Aid Becomes Security Debt: A Systematic Analysis of Insecure Behaviors in LLM Coding Agents

2025-07-12 · Matous Kozak, Roshanak Zilouchian Moghaddam, Siva Sivaraman arxiv

LLM-based coding agents are rapidly being deployed in software development, yet their safety implications remain poorly understood. These agents, while capable of accelerating software development, may exhibit unsafe beh…

Evaluating Privilege Usage of Agents with Real-World Tools

2026-03-30 · Quan Zhang, Lianhang Fu, Lvsi Lian, Gwihwan Go 외 arxiv

Equipping LLM agents with real-world tools can substantially improve productivity. However, granting agents autonomy over tool use also transfers the associated privileges to both the agent and the underlying LLM. Improp…