paper-with-me

홈 › Papers

Offline Contextual Multi-armed Bandits for Mobile Health Interventions: A Case Study on Emotion Regulation

2020-08-21 · Mawulolo K. Ameko, Miranda L. Beltzer, Lihua Cai, Mehdi Boukhechba, Bethany A. Teachman, Laura E. Barnes

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment options can be time-consuming, expensive and altogether unethical in some cases. There is a growing interest in methodological approaches that allow an experimenter to learn and evaluate the usefulness of a new treatment strategy before deployment. We present the first development of a treatment recommender system for emotion regulation using real-world historical mobile digital data from n = 114 high socially anxious participants to test the usefulness of new emotion regulation strategies. We explore a number of offline contextual bandits estimators for learning and propose a general framework for learning algorithms. Our experimentation shows that the proposed doubly robust offline learning algorithms performed significantly better than baseline approaches, suggesting that this type of recommender algorithm could improve emotion regulation. Given that emotion regulation is impaired across many mental illnesses and such a recommender algorithm could be scaled up easily, this approach holds potential to increase access to treatment for many people. We also share some insights that allow us to translate contextual bandit models to this complex real-world data, including which contextual features appear to be most important for predicting emotion regulation strategy effectiveness.

📄 PDF Abstract BibTeX arXiv:2008.09472

Code (0)

등록된 구현이 없습니다.

Tasks

ManagementMulti-Armed BanditsRecommendation Systems

Similar Papers 제목 키워드 기반

Exponentiated Gradient LINUCB for Contextual Multi-Armed Bandits

2013-05-10 · Djallel Bouneffouf

We present Exponentiated Gradient LINUCB, an algorithm for con-textual multi-armed bandits. This algorithm uses Exponentiated Gradient to find the optimal exploration of the LINUCB. Within a deliberately designed offline…

Multi-Armed Bandits

Productization Challenges of Contextual Multi-Armed Bandits

2019-07-10 · David Abensur, Ivan Balashov, Shaked Bar, Ronny Lempel 외

Contextual Multi-Armed Bandits is a well-known and accepted online optimization algorithm, that is used in many Web experiences to tailor content or presentation to users' traffic. Much has been published on theoretical …

Multi-Armed Bandits

Contextual Multi-Armed Bandits for Causal Marketing

2018-10-02 · Neela Sawant, Chitti Babu Namballa, Narayanan Sadagopan, Houssam Nassif

This work explores the idea of a causal contextual multi-armed bandit approach to automated marketing, where we estimate and optimize the causal (incremental) effects. Focusing on causal effect leads to better return on …

Causal InferencecounterfactualMarketingMulti-Armed Bandits+1

Upper Counterfactual Confidence Bounds: a New Optimism Principle for Contextual Bandits

2020-07-15 · Yunbei Xu, Assaf Zeevi

The principle of optimism in the face of uncertainty is one of the most widely used and successful ideas in multi-armed bandits and reinforcement learning. However, existing optimistic algorithms (primarily UCB and its v…

counterfactualMulti-Armed Banditsregression

Deep Contextual Multi-armed Bandits

2018-07-25 · Mark Collier, Hector Urdiales Llorens

Contextual multi-armed bandit problems arise frequently in important industrial applications. Existing solutions model the context either linearly, which enables uncertainty driven (principled) exploration, or non-linear…

MarketingMulti-Armed BanditsThompson Sampling