Basal Glucose Control in Type 1 Diabetes using Deep Reinforcement Learning: An In Silico Validation

2020-05-18 · Taiyu Zhu, Kezhi Li, Pau Herrero, Pantelis Georgiou

People with Type 1 diabetes (T1D) require regular exogenous infusion of insulin to maintain their blood glucose concentration in a therapeutically adequate target range. Although the artificial pancreas and continuous glucose monitoring have been proven to be effective in achieving closed-loop control, significant challenges still remain due to the high complexity of glucose dynamics and limitations in the technology. In this work, we propose a novel deep reinforcement learning model for single-hormone (insulin) and dual-hormone (insulin and glucagon) delivery. In particular, the delivery strategies are developed by double Q-learning with dilated recurrent neural networks. For designing and testing purposes, the FDA-accepted UVA/Padova Type 1 simulator was employed. First, we performed long-term generalized training to obtain a population model. Then, this model was personalized with a small data-set of subject-specific data. In silico results show that the single and dual-hormone delivery strategies achieve good glucose control when compared to a standard basal-bolus therapy with low-glucose insulin suspension. Specifically, in the adult cohort (n=10), percentage time in target range [70, 180] mg/dL improved from 77.6% to 80.9% with single-hormone control, and to $85.6\%$ with dual-hormone control. In the adolescent cohort (n=10), percentage time in target range improved from 55.5% to 65.9% with single-hormone control, and to 78.8% with dual-hormone control. In all scenarios, a significant decrease in hypoglycemia was observed. These results show that the use of deep reinforcement learning is a viable approach for closed-loop glucose control in T1D.

📄 PDF Abstract BibTeX arXiv:2005.09059

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음

Sigmoid Activation 설명 없음

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Double Q-learning Double Q-learning is an off-policy reinforcement learning algorithm that utilises double estimation to counteract overestimation problems with traditional Q-learning. The…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Basal-Bolus Advisor for Type 1 Diabetes (T1D) Patients Using Multi-Agent Reinforcement Learning (RL) Methodology

2023-07-17 · Mehrad Jalolia, Marzia Cescon

This paper presents a novel multi-agent reinforcement learning (RL) approach for personalized glucose control in individuals with type 1 diabetes (T1D). The method employs a closed-loop system consisting of a blood gluco…

Multi-agent Reinforcement Learning Reinforcement Learning (RL)

Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control

2020-10-13 · Taku Yamagata, Aisling O'Kane, Amid Ayobi, Dmitri Katz 외

In this paper we investigate the use of model-based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict …

Model-based Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+4

A dual mode adaptive basal-bolus advisor based on reinforcement learning

2019-01-07 · Qingnan Sun, Marko V. Jankovic, João Budzinski, Brett Moore 외

Self-monitoring of blood glucose (SMBG) and continuous glucose monitoring (CGM) are commonly used by type 1 diabetes (T1D) patients to measure glucose concentrations. The proposed adaptive basal-bolus algorithm (ABBA) su…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Intermittent Control for Safe Long-Acting Insulin Intensification for Type 2 Diabetes: In-Silico Experiment

2023-09-17 · Anas El Fathi, Mohammadreza Ganji, Dimitri Boiroux, Henrik Bengtsson 외

Around a third of type 2 diabetes patients (T2D) are escalated to basal insulin injections. Basal insulin dose is titrated to achieve a tight glycemic target without undue hypoglycemic risk. In the standard of care (SoC)…

Personalised Insulin Adjustment with Reinforcement Learning: An In-Silico Validation for People with Diabetes on Intensive Insulin Treatment

2025-05-20 · Maria Panagiotou, Lorenzo Brigato, Vivien Streit, Amanda Hayoz 외

Despite recent advances in insulin preparations and technology, adjusting insulin remains an ongoing challenge for the majority of people with type 1 diabetes (T1D) and longstanding type 2 diabetes (T2D). In this study, …