paper-with-me

홈 › Papers

Modeling Behavioral Preferences of Cyber Adversaries Using Inverse Reinforcement Learning

2025-05-02 · Aditya Shinde, Prashant Doshi

This paper presents a holistic approach to attacker preference modeling from system-level audit logs using inverse reinforcement learning (IRL). Adversary modeling is an important capability in cybersecurity that lets defenders characterize behaviors of potential attackers, which enables attribution to known cyber adversary groups. Existing approaches rely on documenting an ever-evolving set of attacker tools and techniques to track known threat actors. Although attacks evolve constantly, attacker behavioral preferences are intrinsic and less volatile. Our approach learns the behavioral preferences of cyber adversaries from forensics data on their tools and techniques. We model the attacker as an expert decision-making agent with unknown behavioral preferences situated in a computer host. We leverage attack provenance graphs of audit logs to derive a state-action trajectory of the attack. We test our approach on open datasets of audit logs containing real attack data. Our results demonstrate for the first time that low-level forensics data can automatically reveal an adversary's subjective preferences, which serves as an additional dimension to modeling and documenting cyber adversaries. Attackers' preferences tend to be invariant despite their different tools and indicate predispositions that are inherent to the attacker. As such, these inferred preferences can potentially serve as unique behavioral signatures of attackers and improve threat attribution.

📄 PDF Abstract BibTeX arXiv:2505.03817

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Adversarial Genetic Programming for Cyber Security: A Rising Application Domain Where GP Matters

2020-04-07 · Una-May O'Reilly, Jamal Toutouh, Marcos Pertierra, Daniel Prado Sanchez 외

Cyber security adversaries and engagements are ubiquitous and ceaseless. We delineate Adversarial Genetic Programming for Cyber Security, a research topic that, by means of genetic programming (GP), replicates and studie…

Artificial LifePosition

Quantifying Loss Aversion in Cyber Adversaries via LLM Analysis

2025-08-18 · Soham Hans, Nikolos Gurney, Stacy Marsella, Sofia Hirschmann arxiv

Understanding and quantifying human cognitive biases from empirical data has long posed a formidable challenge, particularly in cybersecurity, where defending against unknown adversaries is paramount. Traditional cyber d…

Using a Collated Cybersecurity Dataset for Machine Learning and Artificial Intelligence

2021-08-05 · Erik Hemberg, Una-May O'Reilly

Artificial Intelligence (AI) and Machine Learning (ML) algorithms can support the span of indicator-level, e.g. anomaly detection, to behavioral level cyber security modeling and inference. This contribution is based on …

Anomaly DetectionBIG-bench Machine Learning

Learner-aware Teaching: Inverse Reinforcement Learning with Preferences and Constraints

2019-06-02 · NeurIPS 2019 12 · Sebastian Tschiatschek, Ahana Ghosh, Luis Haug, Rati Devidze 외

Inverse reinforcement learning (IRL) enables an agent to learn complex behavior by observing demonstrations from a (near-)optimal policy. The typical assumption is that the learner's goal is to match the teacher's demons…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Dynamic Risk Assessments for Offensive Cybersecurity Agents

2025-05-23 · Boyi Wei, Benedikt Stroebl, Jiacen Xu, Joie Zhang 외

Foundation models are increasingly becoming better autonomous programmers, raising the prospect that they could also automate dangerous offensive cyber-operations. Current frontier model audits probe the cybersecurity ri…

GPU