paper-with-me

Papers

Raijū: Reinforcement Learning-Guided Post-Exploitation for Automating Security Assessment of Network Systems

2023-09-27 · Van-Hau Pham, Hien Do Hoang, Phan Thanh Trung, Van Dinh Quoc, Trong-Nghia To, Phan The Duy

In order to assess the risks of a network system, it is important to investigate the behaviors of attackers after successful exploitation, which is called post-exploitation. Although there are various efficient tools supporting post-exploitation implementation, no application can automate this process. Most of the steps of this process are completed by experts who have profound knowledge of security, known as penetration testers or pen-testers. To this end, our study proposes the Raij\=u framework, a Reinforcement Learning (RL)-driven automation approach that assists pen-testers in quickly implementing the process of post-exploitation for security-level evaluation in network systems. We implement two RL algorithms, Advantage Actor-Critic (A2C) and Proximal Policy Optimization (PPO), to train specialized agents capable of making intelligent actions, which are Metasploit modules to automatically launch attacks of privileges escalation, gathering hashdump, and lateral movement. By leveraging RL, we aim to empower these agents with the ability to autonomously select and execute actions that can exploit vulnerabilities in target systems. This approach allows us to automate certain aspects of the penetration testing workflow, making it more efficient and responsive to emerging threats and vulnerabilities. The experiments are performed in four real environments with agents trained in thousands of episodes. The agents automatically select actions and launch attacks on the environments and achieve over 84\% of successful attacks with under 55 attack steps given. Moreover, the A2C algorithm has proved extremely effective in the selection of proper actions for automation of post-exploitation.

📄 PDF Abstract BibTeX arXiv:2309.15518

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

A2C A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous…

Similar Papers 제목 키워드 기반

Evaluation of Reinforcement Learning for Autonomous Penetration Testing using A3C, Q-learning and DQN

2024-07-22 · Norman Becker, Daniel Reti, Evridiki V. Ntagiou, Marcus Wallum 외

Penetration testing is the process of searching for security weaknesses by simulating an attack. It is usually performed by experienced professionals, where scanning and attack tools are applied. By automating the execut…

Decision MakingQ-Learning

PentestMCP: A Toolkit for Agentic Penetration Testing

2025-10-04 · Zachary Ezetta, Wu-chang Feng arxiv

Agentic AI is transforming security by automating many tasks being performed manually. While initial agentic approaches employed a monolithic architecture, the Model-Context-Protocol has now enabled a remote-procedure ca…

Reasoning While Recommending: Entropy-Guided Latent Reasoning in Generative Re-ranking Models

2026-01-20 · Changshuo Zhang arxiv

Reinforcement learning plays a crucial role in generative re-ranking scenarios due to its exploration-exploitation capabilities, but existing generative methods mostly fail to adapt to the dynamic entropy changes in mode…

Reinforcement Learning

$\sbf{\delta^2}$-exploration for Reinforcement Learning

2021-09-29 · Rong Zhu, Mattia Rigotti

Effectively tackling the \emph{exploration-exploitation dilemma} is still a major challenge in reinforcement learning. Uncertainty-based exploration strategies developed in the bandit setting could theoretically offer a …

General Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning+1

Offline Policy Optimization with Posterior Sampling

2026-05-08 · Hongqiang Lin, Dongxu Zhang, Yiding Sun, Mingzhe Li 외 arxiv

A fundamental challenge in model-based offline reinforcement learning (RL) lies in the trade-off between generalization and robustness against exploitation errors in out-of-distribution (OOD) regions. While OOD samples m…

Reinforcement LearningBayesian Inference