paper-with-me

홈 › Papers

Bayesian Collaborative Bandits with Thompson Sampling for Improved Outreach in Maternal Health Program

2024-10-28 · Arpan Dasgupta, Gagan Jain, Arun Suggala, Karthikeyan Shanmugam, Milind Tambe, Aparna Taneja

Mobile health (mHealth) programs face a critical challenge in optimizing the timing of automated health information calls to beneficiaries. This challenge has been formulated as a collaborative multi-armed bandit problem, requiring online learning of a low-rank reward matrix. Existing solutions often rely on heuristic combinations of offline matrix completion and exploration strategies. In this work, we propose a principled Bayesian approach using Thompson Sampling for this collaborative bandit problem. Our method leverages prior information through efficient Gibbs sampling for posterior inference over the low-rank matrix factors, enabling faster convergence. We demonstrate significant improvements over state-of-the-art baselines on a real-world dataset from the world's largest maternal mHealth program. Our approach achieves a $16\%$ reduction in the number of calls compared to existing methods and a $47$\% reduction compared to the deployed random policy. This efficiency gain translates to a potential increase in program capacity by $0.5-1.4$ million beneficiaries, granting them access to vital ante-natal and post-natal care information. Furthermore, we observe a $7\%$ and $29\%$ improvement in beneficiary retention (an extremely hard metric to impact) compared to state-of-the-art and deployed baselines, respectively. Synthetic simulations further demonstrate the superiority of our approach, particularly in low-data regimes and in effectively utilizing prior information. We also provide a theoretical analysis of our algorithm in a special setting using Eluder dimension.

📄 PDF Abstract BibTeX arXiv:2410.21405

Code (0)

등록된 구현이 없습니다.

Tasks

Matrix CompletionThompson Sampling

Similar Papers 제목 키워드 기반

PG-TS: Improved Thompson Sampling for Logistic Contextual Bandits

2018-05-18 · NeurIPS 2018 12 · Bianca Dumitrascu, Karen Feng, Barbara E. Engelhardt

We address the problem of regret minimization in logistic contextual bandits, where a learner decides among sequential actions or arms given their respective contexts to maximize binary rewards. Using a fast inference pr…

Multi-Armed BanditsThompson Sampling

Stacked Thompson Bandits

2017-02-28 · Lenz Belzner, Thomas Gabor

We introduce Stacked Thompson Bandits (STB) for efficiently generating plans that are likely to satisfy a given bounded temporal logic requirement. STB uses a simulation for evaluation of plans, and takes a Bayesian appr…

Thompson Sampling

Distributed Thompson Sampling

2020-12-03 · Jing Dong, Tan Li, Shaolei Ren, Linqi Song

We study a cooperative multi-agent multi-armed bandits with M agents and K arms. The goal of the agents is to minimized the cumulative regret. We adapt a traditional Thompson Sampling algoirthm under the distributed sett…

Multi-Armed BanditsThompson Sampling

On Thompson Sampling for Smoother-than-Lipschitz Bandits

2020-01-08 · James A. Grant, David S. Leslie

Thompson Sampling is a well established approach to bandit and reinforcement learning problems. However its use in continuum armed bandit problems has received relatively little attention. We provide the first bounds on …

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Thompson Sampling

A study of Thompson Sampling with Parameter h

2017-10-05 · Qiang Ha

Thompson Sampling algorithm is a well known Bayesian algorithm for solving stochastic multi-armed bandit. At each time step the algorithm chooses each arm with probability proportional to it being the current best arm. W…

Thompson Sampling