paper-with-me

홈 › Papers

The Partially Observable Games We Play for Cyber Deception

2018-09-28 · Mohamadreza Ahmadi, Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Ufuk Topcu

Progressively intricate cyber infiltration mechanisms have made conventional means of defense, such as firewalls and malware detectors, incompetent. These sophisticated infiltration mechanisms can study the defender's behavior, identify security caveats, and modify their actions adaptively. To tackle these security challenges, cyber-infrastructures require active defense techniques that incorporate cyber deception, in which the defender (deceiver) implements a strategy to mislead the infiltrator. To this end, we use a two-player partially observable stochastic game (POSG) framework, wherein the deceiver has full observability over the states of the POSG, and the infiltrator has partial observability. Then, the deception problem is to compute a strategy for the deceiver that minimizes the expected cost of deception against all strategies of the infiltrator. We first show that the underlying problem is a robust mixed-integer linear program, which is intractable to solve in general. Towards a scalable approach, we compute optimal finite-memory strategies for the infiltrator by a reduction to a series of synthesis problems for parametric Markov decision processes. We use these infiltration strategies to find robust strategies for the deceiver using mixed-integer linear programming. We illustrate the performance of our technique on a POSG model for network security. Our experiments demonstrate that the proposed approach handles scenarios considerably larger than those of the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1810.00092

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Partially Observable Games for Secure Autonomy

2020-02-05 · Mohamadreza Ahmadi, Arun A. Viswanathan, Michel D. Ingham, Kymie Tan 외

Technology development efforts in autonomy and cyber-defense have been evolving independently of each other, over the past decade. In this paper, we report our ongoing effort to integrate these two presently distinct are…

Decision Making

Games with Planned Actions and Scouting

2024-08-19 · Wolfgang Kuhle

We study games in which every action requires planning and preparation. Moreover, before players act, they can revise their plans based on partially revealing information that they receive on their adversary's preparatio…

Learning to Communicate in Multi-Agent Reinforcement Learning for Autonomous Cyber Defence

2025-07-19 · Faizan Contractor, Li Li, Ranwa Al Mallah arxiv

Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained…

Multi-agent Reinforcement Learning

Observation Interference in Partially Observable Assistance Games

2024-12-23 · Scott Emmons, Caspar Oesterheld, Vincent Conitzer, Stuart Russell

We study partially observable assistance games (POAGs), a model of the human-AI value alignment problem which allows the human and the AI assistant to have partial observations. Motivated by concerns of AI deception, we …

HSVI can solve zero-sum Partially Observable Stochastic Games

2022-10-26 · Aurélien Delage, Olivier Buffet, Jilles S. Dibangoye, Abdallah Saffidine

State-of-the-art methods for solving 2-player zero-sum imperfect information games rely on linear programming or regret minimization, though not on dynamic programming (DP) or heuristic search (HS), while the latter are …

Decision MakingHeuristic SearchOpen-Ended Question AnsweringSequential Decision Making