Data-Efficient Reinforcement Learning for Malaria Control
Sequential decision-making under cost-sensitive tasks is prohibitively daunting, especially for the problem that has a significant impact on people's daily lives, such as malaria control, treatment recommendation. The main challenge faced by policymakers is to learn a policy from scratch by interacting with a complex environment in a few trials. This work introduces a practical, data-efficient policy learning method, named Variance-Bonus Monte Carlo Tree Search~(VB-MCTS), which can copy with very little data and facilitate learning from scratch in only a few trials. Specifically, the solution is a model-based reinforcement learning method. To avoid model bias, we apply Gaussian Process~(GP) regression to estimate the transitions explicitly. With the GP world model, we propose a variance-bonus reward to measure the uncertainty about the world. Adding the reward to the planning with MCTS can result in more efficient and effective exploration. Furthermore, the derived polynomial sample complexity indicates that VB-MCTS is sample efficient. Finally, outstanding performance on a competitive world-level RL competition and extensive experimental results verify its advantage over the state-of-the-art on the challenging malaria control task.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingModel-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Sequential Decision MakingSimilar Papers 제목 키워드 기반
An Analysis of Reinforcement Learning for Malaria Control
Previous work on policy learning for Malaria control has often formulated the problem as an optimization problem assuming the objective function and the search space have a specific structure. The problem has been formul…
Multi-Armed BanditsOpenAI Gymreinforcement-learningReinforcement Learning+1Policy Learning for Malaria Control
Sequential decision making is a typical problem in reinforcement learning with plenty of algorithms to solve it. However, only a few of them can work effectively with a very small number of observations. In this report, …
Bayesian OptimizationDecision MakingQ-Learningreinforcement-learning+3Analysis and optimal control of a malaria mathematical model under resistance and population movement
In this work, two mathematical models for malaria under resistance are presented. More precisely, the first model shows the interaction between humans and mosquitoes inside a patch under infection of malaria when the hum…
Modeling and control of malaria dynamics in fish farming regions
In this work we propose a model that represents the relation between fish ponds, the mosquito population and the transmission of malaria. It has been observed that in the Amazonic region of Acre, in the North of Brazil, …
Malaria Likelihood Prediction By Effectively Surveying Households Using Deep Reinforcement Learning
We build a deep reinforcement learning (RL) agent that can predict the likelihood of an individual testing positive for malaria by asking questions about their household. The RL agent learns to determine which survey que…
Deep Reinforcement LearningHoldout SetPredictionreinforcement-learning+3