Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control
In this paper we investigate the use of model-based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict blood glucose levels combined with Model Predictive Controller for planning. Echo State Network is a version of recurrent neural networks which allows us to learn long term dependencies in the input of time series data in an online manner. Additionally, we address the quantification of uncertainty for a more robust control. Here, we used ensembles of Echo State Networks to capture model (epistemic) uncertainty. We evaluated the approach with the FDA-approved UVa/Padova Type 1 Diabetes simulator and compared the results against baseline algorithms such as Basal-Bolus controller and Deep Q-learning. The results suggest that the model-based reinforcement learning algorithm can perform equally or better than the baseline algorithms for the majority of virtual Type 1 Diabetes person profiles tested.
Code (0)
등록된 구현이 없습니다.
Tasks
Model-based Reinforcement LearningQ-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Time SeriesTime Series AnalysisVocal Bursts Type PredictionSimilar Papers 제목 키워드 기반
Blood Glucose Level Prediction in Type 1 Diabetes Using Machine Learning
Type 1 Diabetes is a chronic autoimmune condition in which the immune system attacks and destroys insulin-producing beta cells in the pancreas, resulting in little to no insulin production. Insulin helps glucose in your …
Deep Reinforcement LearningManagementOffline Reinforcement Learning for Safer Blood Glucose Control in People with Type 1 Diabetes
The widespread adoption of effective hybrid closed loop systems would represent an important milestone of care for people living with type 1 diabetes (T1D). These devices typically utilise simple control algorithms to se…
Offline RLReinforcement Learning (RL)Data-Driven Robust Control Using Reinforcement Learning
This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algori…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Precise Insulin Delivery for Artificial Pancreas: A Reinforcement Learning Optimized Adaptive Fuzzy Control Approach
This paper explores the application of reinforcement learning to optimize the parameters of a Type-1 Takagi-Sugeno fuzzy controller, designed to operate as an artificial pancreas for Type 1 diabetes. The primary challeng…
Managementreinforcement-learningReinforcement LearningBasal-Bolus Advisor for Type 1 Diabetes (T1D) Patients Using Multi-Agent Reinforcement Learning (RL) Methodology
This paper presents a novel multi-agent reinforcement learning (RL) approach for personalized glucose control in individuals with type 1 diabetes (T1D). The method employs a closed-loop system consisting of a blood gluco…
Multi-agent Reinforcement LearningReinforcement Learning (RL)