paper-with-me

Papers

Planning to Fairly Allocate: Probabilistic Fairness in the Restless Bandit Setting

2021-06-14 · Christine Herlihy, Aviva Prins, Aravind Srinivasan, John P. Dickerson

Restless and collapsing bandits are often used to model budget-constrained resource allocation in settings where arms have action-dependent transition probabilities, such as the allocation of health interventions among patients. However, state-of-the-art Whittle-index-based approaches to this planning problem either do not consider fairness among arms, or incentivize fairness without guaranteeing it. We thus introduce ProbFair, a probabilistically fair policy that maximizes total expected reward and satisfies the budget constraint while ensuring a strictly positive lower bound on the probability of being pulled at each timestep. We evaluate our algorithm on a real-world application, where interventions support continuous positive airway pressure (CPAP) therapy adherence among patients, as well as on a broader class of synthetic transition matrices. We find that ProbFair preserves utility while providing fairness guarantees.

📄 PDF Abstract BibTeX arXiv:2106.07677

Code (1)

crherlihy/prob_fair_rmab 공식 구현

Tasks

Fairness

Similar Papers 제목 키워드 기반

Efficient Resource Allocation with Fairness Constraints in Restless Multi-Armed Bandits

2022-06-08 · Dexun Li, Pradeep Varakantham

Restless Multi-Armed Bandits (RMAB) is an apt model to represent decision-making problems in public health interventions (e.g., tuberculosis, maternal, and child care), anti-poaching planning, sensor monitoring, personal…

Decision MakingFairnessMulti-Armed Bandits

Fairness for Workers Who Pull the Arms: An Index Based Policy for Allocation of Restless Bandit Tasks

2023-03-01 · Arpita Biswas, Jackson A. Killian, Paula Rodriguez Diaz, Susobhan Ghosh 외

Motivated by applications such as machine repair, project monitoring, and anti-poaching patrol scheduling, we study intervention planning of stochastic processes under resource constraints. This planning problem has prev…

FairnessMulti-Armed BanditsScheduling

Towards Soft Fairness in Restless Multi-Armed Bandits

2022-07-27 · Dexun Li, Pradeep Varakantham

Restless multi-armed bandits (RMAB) is a framework for allocating limited resources under uncertainty. It is an extremely useful model for monitoring beneficiaries and executing timely interventions to ensure maximum ben…

FairnessMulti-Armed Bandits

FairFly: A Fair Motion Planner for Fleets of Autonomous UAVs in Urban Airspace

2020-08-21

We present a solution to the problem of fairly planning a fleet of Unmanned Aerial Vehicles (UAVs) that have different missions and operators, such that no one operator unfairly gets to finish its missions early at the e…

Fairness

Online Restless Multi-Armed Bandits with Long-Term Fairness Constraints

2023-12-16 · Shufan Wang, Guojun Xiong, Jian Li

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under a…

Decision MakingFairnessMulti-Armed BanditsReinforcement Learning (RL)+1