paper-with-me

Papers

sudo rm -rf agentic_security

2025-03-26 · Sejin Lee, Jian Kim, Haon Park, Ashkan Yousefpour, Sangyoon Yu, Min Song

Large Language Models (LLMs) are increasingly deployed as computer-use agents, autonomously performing tasks within real desktop or web environments. While this evolution greatly expands practical use cases for humans, it also creates serious security exposures. We present SUDO (Screen-based Universal Detox2Tox Offense), a novel attack framework that systematically bypasses refusal-trained safeguards in commercial computer-use agents, such as Claude for Computer Use. The core mechanism, Detox2Tox, transforms harmful requests (that agents initially reject) into seemingly benign requests via detoxification, secures detailed instructions from advanced vision language models (VLMs), and then reintroduces malicious content via toxification just before execution. Unlike conventional jailbreaks, SUDO iteratively refines its attacks based on a built-in refusal feedback, making it increasingly effective against robust policy filters. In extensive tests spanning 50 real-world tasks and multiple state-of-the-art VLMs, SUDO achieves a stark attack success rate of 24.41% (with no refinement), and up to 41.33% (by its iterative refinement) in Claude for Computer Use. By revealing these vulnerabilities and demonstrating the ease with which they can be exploited in real-world computing environments, this paper highlights an immediate need for robust, context-aware safeguards. WARNING: This paper includes harmful or offensive model outputs

📄 PDF Abstract BibTeX arXiv:2503.20279

Code (1)

AIM-Intelligence/SUDO 공식 구현

Tasks

Adversarial AttackAI and SafetyReal-World Adversarial AttackRed TeamingSafety Alignment

Similar Papers 제목 키워드 기반

sudoLLM : On Multi-role Alignment of Language Models

2025-05-20 · Soumadeep Saha, Akshay Chaturvedi, Joy Mahapatra, Utpal Garain

User authorization-based access privileges are a key feature in many safety-critical systems, but have thus far been absent from the large language model (LLM) realm. In this work, drawing inspiration from such access co…

Language ModelingLanguage ModellingLarge Language ModelSafety Alignment

AgenticQwen: Training Small Agentic Language Models with Dual Data Flywheels for Industrial-Scale Tool Use

2026-04-23 · Yuanjie Lyu, Chengyu Wang, Haonan Zheng, Yuanhao Yue 외 arxiv

Modern industrial applications increasingly demand language models that act as agents, capable of multi-step reasoning and tool use in real-world settings. These tasks are typically performed under strict cost and latenc…

Reinforcement Learning

A Safety and Security Framework for Real-World Agentic Systems

2025-11-27 · Shaona Ghosh, Barnaby Simkin, Kyriacos Shiarlis, Soumili Nandi 외 arxiv

This paper introduces a dynamic and actionable framework for securing agentic AI systems in enterprise deployment. We contend that safety and security are not merely fixed attributes of individual models but also emergen…

Red Teaming

A Security Analysis of Long-Horizon Agentic AI Systems: Threats, Evaluation, and Framework Development

2026-06-12 · Ahmed Mohammed Almalki, Mehedi Masud arxiv

This paper presents a structured analysis of security challenges in long-horizon agentic AI systems. The study reviews existing threats, evaluation approaches, attack propagation mechanisms, and security frameworks. A ta…

Securing Agentic AI Systems -- A Multilayer Security Framework

2025-12-19 · Sunil Arora, John Hastings arxiv

Securing Agentic Artificial Intelligence (AI) systems requires addressing the complex cyber risks introduced by autonomous, decision-making, and adaptive behaviors. Agentic AI systems are increasingly deployed across ind…