paper-with-me

Papers

Security Considerations for Artificial Intelligence Agents

2026-03-12 · Ninghui Li, Kaiyuan Zhang, Kyle Polley, Jerry Ma arxiv

This article, a lightly adapted version of Perplexity's response to NIST/CAISI Request for Information 2025-0035, details our observations and recommendations concerning the security of frontier AI agents. These insights are informed by Perplexity's experience operating general-purpose agentic systems used by millions of users and thousands of enterprises in both controlled and open-world environments. Agent architectures change core assumptions around code-data separation, authority boundaries, and execution predictability, creating new confidentiality, integrity, and availability failure modes. We map principal attack surfaces across tools, connectors, hosting boundaries, and multi-agent coordination, with particular emphasis on indirect prompt injection, confused-deputy behavior, and cascading failures in long-running workflows. We then assess current defenses as a layered stack: input-level and model-level mitigations, sandboxed execution, and deterministic policy enforcement for high-consequence actions. Finally, we identify standards and research gaps, including adaptive security benchmarks, policy models for delegation and privilege control, and guidance for secure multi-agent system design aligned with NIST risk management principles.

📄 PDF Abstract BibTeX arXiv:2603.12230

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SoK: Security and Privacy of AI Agents for Blockchain

2025-09-08 · Nicolò Romandini, Carlo Mazzocca, Kai Otsuki, Rebecca Montanari arxiv

Blockchain and smart contracts have garnered significant interest in recent years as the foundation of a decentralized, trustless digital ecosystem, thereby eliminating the need for traditional centralized authorities. D…

From Texts to Shields: Convergence of Large Language Models and Cybersecurity

2025-05-01 · Tao Li, Ya-Ting Yang, Yunian Pan, Quanyan Zhu

This report explores the convergence of large language models (LLMs) and cybersecurity, synthesizing interdisciplinary insights from network security, artificial intelligence, formal methods, and human-centered design. I…

Fairness

Cooperation in Human and Machine Agents: Promise Theory Considerations

2026-04-12 · M. Burgess arxiv

Agent based systems are more common than we may think. A Promise Theory perspective on cooperation, in systems of human-machine agents, offers a unified perspective on organization and functional design with semi-automat…

A Taxonomy of Data Risks in AI and Quantum Computing (QAI) - A Systematic Review

2025-09-24 · Grace Billiris, Asif Gill, Madhushi Bandara arxiv

Quantum Artificial Intelligence (QAI), the integration of Artificial Intelligence (AI) and Quantum Computing (QC), promises transformative advances, including AI-enabled quantum cryptography and quantum-resistant encrypt…

Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents

2023-06-05 · Yashar Talebirad, Amirhossein Nadiri

In this paper, we present a novel framework for enhancing the capabilities of large language models (LLMs) by leveraging the power of multi-agent systems. Our framework introduces a collaborative environment where multip…