Autonomous Network Defence using Reinforcement Learning

2024-09-26 · Myles Foley, Chris Hicks, Kate Highnam, Vasilios Mavroudis

In the network security arms race, the defender is significantly disadvantaged as they need to successfully detect and counter every malicious attack. In contrast, the attacker needs to succeed only once. To level the playing field, we investigate the effectiveness of autonomous agents in a realistic network defence scenario. We first outline the problem, provide the background on reinforcement learning and detail our proposed agent design. Using a network environment simulation, with 13 hosts spanning 3 subnets, we train a novel reinforcement learning agent and show that it can reliably defend continual attacks by two advanced persistent threat (APT) red agents: one with complete knowledge of the network layout and another which must discover resources through exploration but is more general.

📄 PDF Abstract BibTeX arXiv:2409.18197

Code (1)

alan-turing-institute/cage-challenge-2-public 공식 구현

Tasks

reinforcement-learning Reinforcement Learning

Entity-based Reinforcement Learning for Autonomous Cyber Defence

2024-10-23 · Isaac Symes Thompson, Alberto Caron, Chris Hicks, Vasilios Mavroudis

A significant challenge for autonomous cyber defence is ensuring a defensive agent's ability to generalise across diverse network topologies and configurations. This capability is necessary for agents to remain effective…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Inroads into Autonomous Network Defence using Explained Reinforcement Learning

2023-06-15 · Myles Foley, Mia Wang, Zoe M, Chris Hicks 외

Computer network defence is a complicated task that has necessitated a high degree of human involvement. However, with recent advancements in machine learning, fully autonomous network defence is becoming increasingly pl…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Learning Cyber Defence Tactics from Scratch with Multi-Agent Reinforcement Learning

2023-08-25 · Jacob Wiebe, Ranwa Al Mallah, Li Li

Recent advancements in deep learning techniques have opened new possibilities for designing solutions for autonomous cyber defence. Teams of intelligent agents in computer network defence roles may reveal promising avenu…

Multi-agent Reinforcement Learning reinforcement-learning

Adversarial Reinforcement Learning under Partial Observability in Autonomous Computer Network Defence

2019-02-25 · Yi Han, David Hubczenko, Paul Montague, Olivier De Vel 외

Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised learning setting. While most exis…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning for Autonomous Defence in Software-Defined Networking

2018-08-17 · Yi Han, Benjamin I. P. Rubinstein, Tamas Abraham, Tansu Alpcan 외

Despite the successful application of machine learning (ML) in a wide range of domains, adaptability---the very property that makes machine learning desirable---can be exploited by adversaries to contaminate training and…

BIG-bench Machine Learning General Classification reinforcement-learning Reinforcement Learning+1