paper-with-me

홈 › Papers

AgenTRIM: Tool Risk Mitigation for Agentic AI

2026-01-18 · Roy Betser, Shamik Bose, Amit Giloni, Chiara Picardi, Sindhu Padakandla, Roman Vainshtein arxiv

AI agents are autonomous systems that combine LLMs with external tools to solve complex tasks. While such tools extend capability, improper tool permissions introduce security risks such as indirect prompt injection and tool misuse. We characterize these failures as unbalanced tool-driven agency. Agents may retain unnecessary permissions (excessive agency) or fail to invoke required tools (insufficient agency), amplifying the attack surface and reducing performance. We introduce AgenTRIM, a framework for detecting and mitigating tool-driven agency risks without altering an agent's internal reasoning. AgenTRIM addresses these risks through complementary offline and online phases. Offline, AgenTRIM reconstructs and verifies the agent's tool interface from code and execution traces. At runtime, it enforces per-step least-privilege tool access through adaptive filtering and status-aware validation of tool calls. Evaluating on the AgentDojo benchmark, AgenTRIM substantially reduces attack success while maintaining high task performance. Additional experiments show robustness to description-based attacks and effective enforcement of explicit safety policies. Together, these results demonstrate that AgenTRIM provides a practical, capability-preserving approach to safer tool use in LLM-based agents.

📄 PDF Abstract BibTeX arXiv:2601.12449

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Safety and Security Framework for Real-World Agentic Systems

2025-11-27 · Shaona Ghosh, Barnaby Simkin, Kyriacos Shiarlis, Soumili Nandi 외 arxiv

This paper introduces a dynamic and actionable framework for securing agentic AI systems in enterprise deployment. We contend that safety and security are not merely fixed attributes of individual models but also emergen…

Red Teaming

AURA: An Agent Autonomy Risk Assessment Framework

2025-10-17 · Lorenzo Satta Chiris, Ayush Mishra arxiv

As autonomous agentic AI systems see increasing adoption across organisations, persistent challenges in alignment, governance, and risk management threaten to impede deployment at scale. We present AURA (Agent aUtonomy R…

Computational Efficiency

Perspectives on a Reliability Monitoring Framework for Agentic AI Systems

2025-11-12 · Niclas Flehmig, Mary Ann Lundteigen, Shen Yin arxiv

The implementation of agentic AI systems has the potential of providing more helpful AI systems in a variety of applications. These systems work autonomously towards a defined goal with reduced external control. Despite …

Out-of-Distribution Detection

Integrating Anomaly Detection into Agentic AI for Proactive Risk Management in Human Activity

2026-04-21 · Farbod Zorriassatine, Ahmad Lotfi arxiv

Agentic AI, with goal-directed, proactive, and autonomous decision-making capabilities, offers a compelling opportunity to address movement-related risks in human activity, including the persistent hazard of falls among …

Anomaly Detection

Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security

2026-05-17 · Jinhu Qi, Muzhi Li, Jiahong Liu, Yuqin Shu 외 arxiv

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failu…