paper-with-me

Papers

Evaluation of Reinforcement Learning for Autonomous Penetration Testing using A3C, Q-learning and DQN

2024-07-22 · Norman Becker, Daniel Reti, Evridiki V. Ntagiou, Marcus Wallum, Hans D. Schotten

Penetration testing is the process of searching for security weaknesses by simulating an attack. It is usually performed by experienced professionals, where scanning and attack tools are applied. By automating the execution of such tools, the need for human interaction and decision-making could be reduced. In this work, a Network Attack Simulator (NASim) was used as an environment to train reinforcement learning agents to solve three predefined security scenarios. These scenarios cover techniques of exploitation, post-exploitation and wiretapping. A large hyperparameter grid search was performed to find the best hyperparameter combinations. The algorithms Q-learning, DQN and A3C were used, whereby A3C was able to solve all scenarios and achieve generalization. In addition, A3C could solve these scenarios with fewer actions than the baseline automated penetration testing. Although the training was performed on rather small scenarios and with small state and action spaces for the agents, the results show that a penetration test can successfully be performed by the RL agent.

📄 PDF Abstract BibTeX arXiv:2407.15656

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingQ-Learning

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…
DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…
Entropy Regularization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
A3C A3C, Asynchronous Advantage Actor Critic, is a policy gradient algorithm in reinforcement learning that maintains a policy $\pi\left(a\_{t}\mid{s}\_{t}; \theta\right)$ and…

Similar Papers 제목 키워드 기반

Deep hierarchical reinforcement agents for automated penetration testing

2021-09-14 · Khuong Tran, Ashlesha Akella, Maxwell Standen, Junae Kim 외

Penetration testing the organised attack of a computer system in order to test existing defences has been used extensively to evaluate network security. This is a time consuming process and requires in-depth knowledge fo…

Deep Reinforcement LearningQ-Learning

PentestEval: Benchmarking LLM-based Penetration Testing with Modular and Stage-Level Design

2025-12-16 · Ruozhao Yang, Mingfei Cheng, Gelei Deng, Tianwei Zhang 외 arxiv

Penetration testing is essential for assessing and strengthening system security against real-world threats, yet traditional workflows remain highly manual, expertise-intensive, and difficult to scale. Although recent ad…

Domain Adaptation

HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testing

2024-12-02 · Lajos Muzsai, David Imolai, András Lukács

We introduce HackSynth, a novel Large Language Model (LLM)-based agent capable of autonomous penetration testing. HackSynth's dual-module architecture includes a Planner and a Summarizer, which enable it to generate comm…

Language ModelingLanguage ModellingLarge Language Model

AutoPenBench: Benchmarking Generative Agents for Penetration Testing

2024-10-04 · Luca Gioacchini, Marco Mellia, Idilio Drago, Alexander Delsanto 외

Generative AI agents, software systems powered by Large Language Models (LLMs), are emerging as a promising approach to automate cybersecurity tasks. Among the others, penetration testing is a challenging field due to th…

Benchmarking

Mind the Gap: Towards Generalizable Autonomous Penetration Testing via Domain Randomization and Meta-Reinforcement Learning

2024-12-05 · Shicheng Zhou, Jingju Liu, Yuliang Lu, Jiahai Yang 외

With increasing numbers of vulnerabilities exposed on the internet, autonomous penetration testing (pentesting) has emerged as a promising research area. Reinforcement learning (RL) is a natural fit for studying this top…

Large Language ModelMeta Reinforcement LearningReinforcement Learning (RL)