A Dual-Hormone Closed-Loop Delivery System for Type 1 Diabetes Using Deep Reinforcement Learning
We propose a dual-hormone delivery strategy by exploiting deep reinforcement learning (RL) for people with Type 1 Diabetes (T1D). Specifically, double dilated recurrent neural networks (RNN) are used to learn the hormone delivery strategy, trained by a variant of Q-learning, whose inputs are raw data of glucose \& meal carbohydrate and outputs are dual-hormone (insulin and glucagon) delivery. Without prior knowledge of the glucose-insulin metabolism, we run the method on the UVA/Padova simulator. Hundreds days of self-play are performed to obtain a generalized model, then importance sampling is adopted to customize the model for personal use. \emph{In-silico} the proposed strategy achieves glucose time in target range (TIR) $93\%$ for adults and $83\%$ for adolescents given standard bolus, outperforming previous approaches significantly. The results indicate that deep RL is effective in building personalized hormone delivery strategy for people with T1D.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningQ-LearningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Basal Glucose Control in Type 1 Diabetes using Deep Reinforcement Learning: An In Silico Validation
People with Type 1 diabetes (T1D) require regular exogenous infusion of insulin to maintain their blood glucose concentration in a therapeutically adequate target range. Although the artificial pancreas and continuous gl…
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning (RL)An AI-enabled dual-hormone model predictive control algorithm that delivers insulin and pramlintide
Current closed-loop insulin delivery algorithms need to be informed of carbohydrate intake disturbances. This can be a burden on people using these systems. Pramlintide is a hormone that delays gastric emptying, which en…
Model Predictive ControlClosed-Loop Molecular Communication with Local and Global Degradation: Modeling and ISI Analysis
This paper presents a novel physics-based model for signal propagation in closed-loop molecular communication (MC) systems, which are particularly relevant for many envisioned biomedical applications, such as health moni…
S-AI-Recursive: Convergent Recursive Reasoning
This article introduces S-AI-Recursive, a bio-inspired Sparse Artificial Intelligence architecture in which reasoning is implemented as a hormonally regulated closed-loop iteration rather than a single feed-forward pass.…
Toward a closed-loop subcutaneous delivery of L-DOPA
L-DOPA has been the gold standard treatment for Parkinson's disease since 50 years. Being the direct biochemical precursor of dopamine, L-DOPA is effectively converted in the brain, but two major phenomena reduce its the…