Developing Optimal Causal Cyber-Defence Agents via Cyber Security Simulation
In this paper we explore cyber security defence, through the unification of a novel cyber security simulator with models for (causal) decision-making through optimisation. Particular attention is paid to a recently published approach: dynamic causal Bayesian optimisation (DCBO). We propose that DCBO can act as a blue agent when provided with a view of a simulated network and a causal model of how a red agent spreads within that network. To investigate how DCBO can perform optimal interventions on host nodes, in order to reduce the cost of intrusions caused by the red agent. Through this we demonstrate a complete cyber-simulation system, which we use to generate observational data for DCBO and provide numerical quantitative results which lay the foundations for future work in this space.
Code (3)
Tasks
Bayesian OptimisationDecision MakingSimilar Papers 제목 키워드 기반
Prospective Artificial Intelligence Approaches for Active Cyber Defence
Cybercriminals are rapidly developing new malicious tools that leverage artificial intelligence (AI) to enable new classes of adaptive and stealthy attacks. New defensive methods need to be developed to counter these thr…
Causal InferencePositionreinforcement-learningReinforcement Learning (RL)Beyond Rewards in Reinforcement Learning for Cyber Defence
Recent years have seen an explosion of interest in autonomous cyber defence agents trained to defend computer networks using deep reinforcement learning. These agents are typically trained in cyber gym environments using…
Reinforcement LearningLess is more? Rewards in RL for Cyber Defence
The last few years have seen an explosion of interest in autonomous cyber defence agents based on deep reinforcement learning. Such agents are typically trained in a cyber gym environment, also known as a cyber simulator…
Deep Reinforcement LearningAutomated Cyber Defence: A Review
Within recent times, cybercriminals have curated a variety of organised and resolute cyber attacks within a range of cyber systems, leading to consequential ramifications to private and governmental institutions. Current…
Decision MakingSequential Decision MakingLearning Cyber Defence Tactics from Scratch with Multi-Agent Reinforcement Learning
Recent advancements in deep learning techniques have opened new possibilities for designing solutions for autonomous cyber defence. Teams of intelligent agents in computer network defence roles may reveal promising avenu…
Multi-agent Reinforcement Learningreinforcement-learning