Deep Reinforcement Learning for Green Security Games with Real-Time Information

2018-11-06 · Yufei Wang, Zheyuan Ryan Shi, Lantao Yu, Yi Wu, Rohit Singh, Lucas Joppa, Fei Fang

Green Security Games (GSGs) have been proposed and applied to optimize patrols conducted by law enforcement agencies in green security domains such as combating poaching, illegal logging and overfishing. However, real-time information such as footprints and agents' subsequent actions upon receiving the information, e.g., rangers following the footprints to chase the poacher, have been neglected in previous work. To fill the gap, we first propose a new game model GSG-I which augments GSGs with sequential movement and the vital element of real-time information. Second, we design a novel deep reinforcement learning-based algorithm, DeDOL, to compute a patrolling strategy that adapts to the real-time information against a best-responding attacker. DeDOL is built upon the double oracle framework and the policy-space response oracle, solving a restricted game and iteratively adding best response strategies to it through training deep Q-networks. Exploring the game structure, DeDOL uses domain-specific heuristic strategies as initial strategies and constructs several local modes for efficient and parallelized training. To our knowledge, this is the first attempt to use Deep Q-Learning for security games.

📄 PDF Abstract BibTeX arXiv:1811.02483

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Interpretable Deep Reinforcement Learning for Green Security Games with Real-Time Information

2022-11-09 · Vishnu Dutt Sharma, John P. Dickerson, Pratap Tokekar

Green Security Games with real-time information (GSG-I) add the real-time information about the agents' movement to the typical GSG formulation. Prior works on GSG-I have used deep reinforcement learning (DRL) to learn t…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Evolutionary Approach to Security Games with Signaling

2022-04-29 · Adam Żychowski, Jacek Mańdziuk, Elizabeth Bondi, Aravind Venugopal 외

Green Security Games have become a popular way to model scenarios involving the protection of natural resources, such as wildlife. Sensors (e.g. drones equipped with cameras) have also begun to play a role in these scena…

Robust Reinforcement Learning Under Minimax Regret for Green Security

2021-06-15 · Lily Xu, Andrew Perrault, Fei Fang, Haipeng Chen 외

Green security domains feature defenders who plan patrols in the face of uncertainty about the adversarial behavior of poachers, illegal loggers, and illegal fishers. Importantly, the deterrence effect of patrols on adve…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Targets in Reinforcement Learning to solve Stackelberg Security Games

2022-11-30 · Saptarashmi Bandyopadhyay, Chenqi Zhu, Philip Daniel, Joshua Morrison 외

Reinforcement Learning (RL) algorithms have been successfully applied to real world situations like illegal smuggling, poaching, deforestation, climate change, airport security, etc. These scenarios can be framed as Stac…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

End-to-End Game-Focused Learning of Adversary Behavior in Security Games

2019-03-03 · Andrew Perrault, Bryan Wilder, Eric Ewing, Aditya Mate 외

Stackelberg security games are a critical tool for maximizing the utility of limited defense resources to protect important targets from an intelligent adversary. Motivated by green security, where the defender may only …