Deep Reinforcement Learning for Backup Strategies against Adversaries

2021-02-12 · Pascal Debus, Nicolas Müller, Konstantin Böttinger

Many defensive measures in cyber security are still dominated by heuristics, catalogs of standard procedures, and best practices. Considering the case of data backup strategies, we aim towards mathematically modeling the underlying threat models and decision problems. By formulating backup strategies in the language of stochastic processes, we can translate the challenge of finding optimal defenses into a reinforcement learning problem. This enables us to train autonomous agents that learn to optimally support planning of defense processes. In particular, we tackle the problem of finding an optimal backup scheme in the following adversarial setting: Given $k$ backup devices, the goal is to defend against an attacker who can infect data at one time but chooses to destroy or encrypt it at a later time, potentially also corrupting multiple backups made in between. In this setting, the usual round-robin scheme, which always replaces the oldest backup, is no longer optimal with respect to avoidable exposure. Thus, to find a defense strategy, we model the problem as a hybrid discrete-continuous action space Markov decision process and subsequently solve it using deep deterministic policy gradients. We show that the proposed algorithm can find storage device update schemes which match or exceed existing schemes with respect to various exposure metrics.

📄 PDF Abstract BibTeX arXiv:2102.06632

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Adaptive Tree Backup Algorithms for Temporal-Difference Reinforcement Learning

2022-06-04 · Brett Daley, Isaac Chan

Q($\sigma$) is a recently proposed temporal-difference learning method that interpolates between learning from expected backups and sampled backups. It has been shown that intermediate values for the interpolation parame…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe Exploration in Reinforcement Learning: Training Backup Control Barrier Functions with Zero Training Time Safety Violations

2023-12-13 · Pedram Rabiee, Amirsaeid Safari

This paper introduces the reinforcement learning backup shield (RLBUS), an algorithm that guarantees safe exploration in reinforcement learning (RL) by incorporating backup control barrier functions (BCBFs). RLBUS constr…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration+1

Hierarchical Multi-agent Reinforcement Learning for Cyber Network Defense

2024-10-22 · Aditya Vikram Singh, Ethan Rathbun, Emma Graham, Lisa Oakley 외

Recent advances in multi-agent reinforcement learning (MARL) have created opportunities to solve complex real-world tasks. Cybersecurity is a notable application area, where defending networks against sophisticated adver…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

On Credit Assignment in Hierarchical Reinforcement Learning

2022-03-07 · Joery A. de Vries, Thomas M. Moerland, Aske Plaat

Hierarchical Reinforcement Learning (HRL) has held longstanding promise to advance reinforcement learning. Yet, it has remained a considerable challenge to develop practical algorithms that exhibit some of these promises…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Towards Causal Models for Adversary Distractions

2021-04-21 · Ron Alford, Andy Applebaum

Automated adversary emulation is becoming an indispensable tool of network security operators in testing and evaluating their cyber defenses. At the same time, it has exposed how quickly adversaries can propagate through…