paper-with-me

홈 › Papers

Learning Red Agent Policy from Observations for Neurosymbolic Autonomous Cyber Agents

2026-06-16 · Ankita Samaddar, Sandeep Neema, Daniel Balasubramanian, Xenofon Koutsoukos arxiv

With sophisticated cyber-attacks becoming increasingly prevalent, modern networks require intelligent autonomous cyber-defense agents trained via Reinforcement Learning (RL). These agents employ neurosymbolic approaches such as behavior trees with learning-enabled components (LECs) to learn, reason, adapt, and implement security rules while maintaining critical operations. However, these autonomous networks are partially observable systems, i.e., the cyber-attacker's (red agent's) actions are not observable, making it difficult for the defender to predict red actions, learn red policies, or assess the attacker's intrusion levels. To address this, we propose a Policy Learning Technique using imitation learning to learn policies for partially observable RL agents with discrete states and discrete actions. We apply this technique in an autonomous cyber environment to predict red agent's actions from network observations and defender actions. Integrated with a neurosymbolic cyber-defense agent, our method effectively handles different red policies and achieves high prediction accuracy across diverse simulated scenarios.

📄 PDF Abstract BibTeX arXiv:2606.18223

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Out-of-Distribution Detection for Neurosymbolic Autonomous Cyber Agents

2024-12-03 · Ankita Samaddar, Nicholas Potteiger, Xenofon Koutsoukos

Autonomous agents for cyber applications take advantage of modern defense techniques by adopting intelligent agents with conventional and learning-enabled components. These intelligent agents are trained via reinforcemen…

Out-of-Distribution DetectionReinforcement Learning (RL)

NeuroStrata: Harnessing Neurosymbolic Paradigms for Improved Design, Testability, and Verifiability of Autonomous CPS

2025-02-17 · Xi Zheng, Ziyang Li, Ivan Ruchkin, Ruzica Piskac 외

Autonomous cyber-physical systems (CPSs) leverage AI for perception, planning, and control but face trust and safety certification challenges due to inherent uncertainties. The neurosymbolic paradigm replaces stochastic …

On the use of neurosymbolic AI for defending against cyber attacks

2024-08-09 · Gudmund Grov, Jonas Halvorsen, Magnus Wiik Eckhoff, Bjørn Jervell Hansen 외

It is generally accepted that all cyber attacks cannot be prevented, creating a need for the ability to detect and respond to cyber attacks. Both connectionist and symbolic AI are currently being used to support such det…

Large Language Model Integration with Reinforcement Learning to Augment Decision-Making in Autonomous Cyber Operations

2025-08-28 · Konur Tholl, François Rivest, Mariam El Mezouar, Adrian Taylor 외 arxiv

Reinforcement Learning (RL) has shown great potential for autonomous decision-making in the cybersecurity domain, enabling agents to learn through direct environment interaction. However, RL agents in Autonomous Cyber Op…

Reinforcement Learning

Entity-based Reinforcement Learning for Autonomous Cyber Defence

2024-10-23 · Isaac Symes Thompson, Alberto Caron, Chris Hicks, Vasilios Mavroudis

A significant challenge for autonomous cyber defence is ensuring a defensive agent's ability to generalise across diverse network topologies and configurations. This capability is necessary for agents to remain effective…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning