Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity

2019-09-08 · Peng Liao, Kristjan Greenewald, Predrag Klasnja, Susan Murphy

With the recent evolution of mobile health technologies, health scientists are increasingly interested in developing just-in-time adaptive interventions (JITAIs), typically delivered via notification on mobile device and designed to help the user prevent negative health outcomes and promote the adoption and maintenance of healthy behaviors. A JITAI involves a sequence of decision rules (i.e., treatment policy) that takes the user's current context as input and specifies whether and what type of an intervention should be provided at the moment. In this paper, we develop a Reinforcement Learning (RL) algorithm that continuously learns and improves the treatment policy embedded in the JITAI as the data is being collected from the user. This work is motivated by our collaboration on designing the RL algorithm in HeartSteps V2 based on data from HeartSteps V1. HeartSteps is a physical activity mobile health application. The RL algorithm developed in this paper is being used in HeartSteps V2 to decide, five times per day, whether to deliver a context-tailored activity suggestion.

📄 PDF Abstract BibTeX arXiv:1909.03539

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Diffusion-Model Subpopulation Digital Twin for Mobile Health Deployment: A Case Study on the HeartSteps Intervention

2026-07-23 · Ziping Xu, Yuyi Chang, Chenshun Ni, Nithin Sugavanam 외 arxiv

Mobile-health interventions increasingly use online learning and decision making algorithms to personalize when to nudge users toward healthier behavior, but a poorly designed algorithm can burden and disengage participa…

Decision Making

Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling

2023-04-11 · Susobhan Ghosh, Raphael Kim, Prasidh Chhabria, Raaz Dwivedi 외

There is a growing interest in using reinforcement learning (RL) to personalize sequences of treatments in digital health to support users in adopting healthier behaviors. Such sequential decision-making problems involve…

Decision Making Reinforcement Learning (RL)Sequential Decision Making

A Reinforcement Learning System to Encourage Physical Activity in Diabetes Patients

2016-05-13 · Irit Hochberg, Guy Feraru, Mark Kozdoba, Shie Mannor 외

Regular physical activity is known to be beneficial to people suffering from diabetes type 2. Nevertheless, most such people are sedentary. Smartphones create new possibilities for helping people to adhere to their physi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Personalized Multimorbidity Management for Patients with Type 2 Diabetes Using Reinforcement Learning of Electronic Health Records

2020-10-29 · Hua Zheng, Ilya O. Ryzhov, Wei Xie, Judy Zhong

Comorbid chronic conditions are common among people with type 2 diabetes. We developed an Artificial Intelligence algorithm, based on Reinforcement Learning (RL), for personalized diabetes and multi-morbidity management …

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Designing and evaluating an online reinforcement learning agent for physical exercise recommendations in N-of-1 trials

2023-09-25 · Dominik Meier, Ipek Ensari, Stefan Konigorski

Personalized adaptive interventions offer the opportunity to increase patient benefits, however, there are challenges in their planning and implementation. Once implemented, it is an important question whether personaliz…

reinforcement-learning Reinforcement Learning