paper-with-me

Papers

Learning Adversary Behavior in Security Games: A PAC Model Perspective

2015-10-30 · Arunesh Sinha, Debarun Kar, Milind Tambe

Recent applications of Stackelberg Security Games (SSG), from wildlife crime to urban crime, have employed machine learning tools to learn and predict adversary behavior using available data about defender-adversary interactions. Given these recent developments, this paper commits to an approach of directly learning the response function of the adversary. Using the PAC model, this paper lays a firm theoretical foundation for learning in SSGs (e.g., theoretically answer questions about the numbers of samples required to learn adversary behavior) and provides utility guarantees when the learned adversary model is used to plan the defender's strategy. The paper also aims to answer practical questions such as how much more data is needed to improve an adversary model's accuracy. Additionally, we explain a recently observed phenomenon that prediction accuracy of learned adversary behavior is not enough to discover the utility maximizing defender strategy. We provide four main contributions: (1) a PAC model of learning adversary response functions in SSGs; (2) PAC-model analysis of the learning of key, existing bounded rationality models in SSGs; (3) an entirely new approach to adversary modeling based on a non-parametric class of response functions with PAC-model analysis and (4) identification of conditions under which computing the best defender strategy against the learned adversary behavior is indeed the optimal strategy. Finally, we conduct experiments with real-world data from a national park in Uganda, showing the benefit of our new adversary modeling approach and verification of our PAC model predictions.

📄 PDF Abstract BibTeX arXiv:1511.00043

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

End-to-End Game-Focused Learning of Adversary Behavior in Security Games

2019-03-03 · Andrew Perrault, Bryan Wilder, Eric Ewing, Aditya Mate 외

Stackelberg security games are a critical tool for maximizing the utility of limited defense resources to protect important targets from an intelligent adversary. Motivated by green security, where the defender may only …

Bilateral Cognitive Security Games in Networked Control Systems under Stealthy Injection Attacks

2025-05-02 · Anh Tung Nguyen, Quanyan Zhu, André Teixeira

This paper studies a strategic security problem in networked control systems under stealthy false data injection attacks. The security problem is modeled as a bilateral cognitive security game between a defender and an a…

Multi-agent Reinforcement Learning in Bayesian Stackelberg Markov Games for Adaptive Moving Target Defense

2020-07-20 · Sailik Sengupta, Subbarao Kambhampati

The field of cybersecurity has mostly been a cat-and-mouse game with the discovery of new attacks leading the way. To take away an attacker's advantage of reconnaissance, researchers have proposed proactive defense metho…

Multi-agent Reinforcement LearningQ-LearningReinforcement Learning (RL)

Learning Movement Strategies for Moving Target Defense

2021-01-01 · Sailik Sengupta, Subbarao Kambhampati

The field of cybersecurity has mostly been a cat-and-mouse game with the discovery of new attacks leading the way. To take away an attacker's advantage of reconnaissance, researchers have proposed proactive defense metho…

Q-Learning

Recursive Deep Inverse Reinforcement Learning

2025-04-17 · Paul Ghanem, Michael Potter, Owen Howell, Pau Closas 외

Inferring an adversary's goals from exhibited behavior is crucial for counterplanning and non-cooperative multi-agent systems in domains like cybersecurity, military, and strategy games. Deep Inverse Reinforcement Learni…

reinforcement-learningReinforcement Learning