Inroads into Autonomous Network Defence using Explained Reinforcement Learning

2023-06-15 · Myles Foley, Mia Wang, Zoe M, Chris Hicks, Vasilios Mavroudis

Computer network defence is a complicated task that has necessitated a high degree of human involvement. However, with recent advancements in machine learning, fully autonomous network defence is becoming increasingly plausible. This paper introduces an end-to-end methodology for studying attack strategies, designing defence agents and explaining their operation. First, using state diagrams, we visualise adversarial behaviour to gain insight about potential points of intervention and inform the design of our defensive models. We opt to use a set of deep reinforcement learning agents trained on different parts of the task and organised in a shallow hierarchy. Our evaluation shows that the resulting design achieves a substantial performance improvement compared to prior work. Finally, to better investigate the decision-making process of our agents, we complete our analysis with a feature ablation and importance study.

📄 PDF Abstract BibTeX arXiv:2306.09318

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement Learningreinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

OPT OPT is a suite of decoder-only pre-trained transformers ranging from 125M to 175B parameters. The model uses an AdamW optimizer and weight decay of 0.1. It follows a linear…

Entity-based Reinforcement Learning for Autonomous Cyber Defence

2024-10-23 · Isaac Symes Thompson, Alberto Caron, Chris Hicks, Vasilios Mavroudis

A significant challenge for autonomous cyber defence is ensuring a defensive agent's ability to generalise across diverse network topologies and configurations. This capability is necessary for agents to remain effective…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Learning Cyber Defence Tactics from Scratch with Multi-Agent Reinforcement Learning

2023-08-25 · Jacob Wiebe, Ranwa Al Mallah, Li Li

Recent advancements in deep learning techniques have opened new possibilities for designing solutions for autonomous cyber defence. Teams of intelligent agents in computer network defence roles may reveal promising avenu…

Multi-agent Reinforcement Learning reinforcement-learning

Adversarial Reinforcement Learning under Partial Observability in Autonomous Computer Network Defence

2019-02-25 · Yi Han, David Hubczenko, Paul Montague, Olivier De Vel 외

Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised learning setting. While most exis…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Autonomous Network Defence using Reinforcement Learning

2024-09-26 · Myles Foley, Chris Hicks, Kate Highnam, Vasilios Mavroudis

In the network security arms race, the defender is significantly disadvantaged as they need to successfully detect and counter every malicious attack. In contrast, the attacker needs to succeed only once. To level the pl…

reinforcement-learning Reinforcement Learning

Reinforcement Learning for Autonomous Defence in Software-Defined Networking

2018-08-17 · Yi Han, Benjamin I. P. Rubinstein, Tamas Abraham, Tansu Alpcan 외

Despite the successful application of machine learning (ML) in a wide range of domains, adaptability---the very property that makes machine learning desirable---can be exploited by adversaries to contaminate training and…

BIG-bench Machine Learning General Classification reinforcement-learning Reinforcement Learning+1