paper-with-me

Papers

Cochise: A Reference Harness for Autonomous Penetration Testing

2026-05-12 · Andreas Happe, Jürgen Cito arxiv

Recent work on LLM-driven autonomous penetration testing reports promising results, but existing systems often combine many architectural, prompting, and tool-integration choices, making it difficult to tell what is gained over a simple agent scaffold. We present cochise, a 597 LOC Python reference harness for autonomous penetration-testing experiments. Cochise connects an LLM-driven agent to a Linux execution host over SSH and supports controlled target environments reachable from that jump host. The prototype implements a separated Planner--Executor architecture in which long-term state is maintained outside the LLM context, while a ReAct-style executor issues commands over SSH and self-corrects based on command outputs. The scenario prompt can be adapted to different target environments. To demonstrate the efficacy of our minimal harness, we evaluate it against a live third-party testbed called Game of Active Directory (GOAD). Alongside the harness, we release replay and analysis tools: (i) cochise-replay for offline visualization of captured runs, (ii) cochise-analyze-alogs and cochise-analyze-graphs for cost, token, duration, and compromise analysis, and (iii) a corpus of JSON trajectory logs from GOAD runs, allowing researchers to study agent behavior without provisioning the 48--64 GB RAM / 190 GB storage testbed themselves. Cochise is intended not as a state-of-the-art pen-testing agent, but as reusable experimental infrastructure for comparing models, agent architectures, and penetration-testing traces.

📄 PDF Abstract BibTeX arXiv:2605.11671

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testing

2024-12-02 · Lajos Muzsai, David Imolai, András Lukács

We introduce HackSynth, a novel Large Language Model (LLM)-based agent capable of autonomous penetration testing. HackSynth's dual-module architecture includes a Planner and a Summarizer, which enable it to generate comm…

Language ModelingLanguage ModellingLarge Language Model

xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language Models

2025-09-16 · Phung Duc Luong, Le Tran Gia Bao, Nguyen Vu Khai Tam, Dong Huu Nguyen Khoa 외 arxiv

This work introduces xOffense, an AI-driven, multi-agent penetration testing framework that shifts the process from labor-intensive, expert-driven manual efforts to fully automated, machine-executable workflows capable o…

PentestEval: Benchmarking LLM-based Penetration Testing with Modular and Stage-Level Design

2025-12-16 · Ruozhao Yang, Mingfei Cheng, Gelei Deng, Tianwei Zhang 외 arxiv

Penetration testing is essential for assessing and strengthening system security against real-world threats, yet traditional workflows remain highly manual, expertise-intensive, and difficult to scale. Although recent ad…

Domain Adaptation

AutoPenBench: Benchmarking Generative Agents for Penetration Testing

2024-10-04 · Luca Gioacchini, Marco Mellia, Idilio Drago, Alexander Delsanto 외

Generative AI agents, software systems powered by Large Language Models (LLMs), are emerging as a promising approach to automate cybersecurity tasks. Among the others, penetration testing is a challenging field due to th…

Benchmarking

Deep hierarchical reinforcement agents for automated penetration testing

2021-09-14 · Khuong Tran, Ashlesha Akella, Maxwell Standen, Junae Kim 외

Penetration testing the organised attack of a computer system in order to test existing defences has been used extensively to evaluate network security. This is a time consuming process and requires in-depth knowledge fo…

Deep Reinforcement LearningQ-Learning