Deep Reinforcement Learning for Control of Probabilistic Boolean Networks

2019-09-07 · Georgios Papagiannis, Sotiris Moschoyiannis

Probabilistic Boolean Networks (PBNs) were introduced as a computational model for the study of complex dynamical systems, such as Gene Regulatory Networks (GRNs). Controllability in this context is the process of making strategic interventions to the state of a network in order to drive it towards some other state that exhibits favourable biological properties. In this paper we study the ability of a Double Deep Q-Network with Prioritized Experience Replay in learning control strategies within a finite number of time steps that drive a PBN towards a target state, typically an attractor. The control method is model-free and does not require knowledge of the network's underlying dynamics, making it suitable for applications where inference of such dynamics is intractable. We present extensive experiment results on two synthetic PBNs and the PBN model constructed directly from gene-expression data of a study on metastatic-melanoma.

📄 PDF Abstract BibTeX arXiv:1909.03331

Code (2)

jakub-zarzycki2022/gym-pbn-stac

uos-plccn/gym-pbn

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Q-learning Based Optimal False Data Injection Attack on Probabilistic Boolean Control Networks

2023-11-29 · Xianlun Peng, Yang Tang, Fangfei Li, Yang Liu

In this paper, we present a reinforcement learning (RL) method for solving optimal false data injection attack problems in probabilistic Boolean control networks (PBCNs) where the attacker lacks knowledge of the system m…

Q-Learning reinforcement-learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Stabilization of Large-scale Probabilistic Boolean Networks

2022-10-21 · Sotiris Moschoyiannis, Evangelos Chatzaroulas, Vytenis Sliogeris, Yuhu Wu

The ability to direct a Probabilistic Boolean Network (PBN) to a desired state is important to applications such as targeted therapeutics in cancer biology. Reinforcement Learning (RL) has been proposed as a framework th…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Deep Reinforcement Learning Based Optimal Infinite-Horizon Control of Probabilistic Boolean Control Networks

2023-04-07 · Jingjie Ni, Fangfei Li, Zheng-Guang Wu

In this paper, a deep reinforcement learning based method is proposed to obtain optimal policies for optimal infinite-horizon control of probabilistic Boolean control networks (PBCNs). Compared with the existing literatu…

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning

Distributed Pinning Control Design for Probabilistic Boolean Networks

2019-12-07 · Lin Lin, Jinde Cao, Jianquan Lu, Jie Zhong

This paper investigates the stabilization of probabilistic Boolean networks (PBNs) via a novel pinning control strategy based on network structure. In a PBN, each node needs to choose a Boolean function from candidate Bo…

Control-Tutored Reinforcement Learning: Towards the Integration of Data-Driven and Model-Based Control

2021-12-11 · F. De Lellis, M. Coraggio, G. Russo, M. Musolesi 외

We present an architecture where a feedback controller derived on an approximate model of the environment assists the learning process to enhance its data efficiency. This architecture, which we term as Control-Tutored Q…

OpenAI Gym Q-Learning Reinforcement Learning (RL)