Learning Resource Allocation Policies from Observational Data with an Application to Homeless Services Delivery

2022-01-25 · Aida Rahmattalabi, Phebe Vayanos, Kathryn Dullerud, Eric Rice

We study the problem of learning, from observational data, fair and interpretable policies that effectively match heterogeneous individuals to scarce resources of different types. We model this problem as a multi-class multi-server queuing system where both individuals and resources arrive stochastically over time. Each individual, upon arrival, is assigned to a queue where they wait to be matched to a resource. The resources are assigned in a first come first served (FCFS) fashion according to an eligibility structure that encodes the resource types that serve each queue. We propose a methodology based on techniques in modern causal inference to construct the individual queues as well as learn the matching outcomes and provide a mixed-integer optimization (MIO) formulation to optimize the eligibility structure. The MIO problem maximizes policy outcome subject to wait time and fairness constraints. It is very flexible, allowing for additional linear domain constraints. We conduct extensive analyses using synthetic and real-world data. In particular, we evaluate our framework using data from the U.S. Homeless Management Information System (HMIS). We obtain wait times as low as an FCFS policy while improving the rate of exit from homelessness for underserved or vulnerable groups (7% higher for the Black individuals and 15% higher for those below 17 years old) and overall.

📄 PDF Abstract BibTeX arXiv:2201.10053

Code (0)

등록된 구현이 없습니다.

Tasks

Causal Inference Fairness Management

AllSim: Simulating and Benchmarking Resource Allocation Policies in Multi-User Systems

2023-09-26 · NeurIPS 2023 11

Numerous real-world systems, ranging from healthcare to energy grids, involve users competing for finite and potentially scarce resources. Designing policies for resource allocation in such real-world systems is challeng…

Learning policies for resource allocation in business processes

2023-04-19 · J. Middelhuis, R. Lo Bianco, E. Scherzer, Z. A. Bukhsh 외

Efficient allocation of resources to activities is pivotal in executing business processes but remains challenging. While resource allocation methodologies are well-established in domains like manufacturing, their applic…

Deep Reinforcement Learning Management

Sales Channel Optimization via Simulations Based on Observational Data with Delayed Rewards: A Case Study at LinkedIn

2022-09-16 · Diana M. Negoescu, Pasha Khosravi, Shadow Zhao, Nanyu Chen 외

Training models on data obtained from randomized experiments is ideal for making good decisions. However, randomized experiments are often time-consuming, expensive, risky, infeasible or unethical to perform, leaving dec…

Decision Making

Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless Networks

2025-02-03 · Shubham Malhotra, Fnu Yashu, Muhammad Saqib, Dipkumar Mehta 외

This report investigates the application of deep reinforcement learning (DRL) algorithms for dynamic resource allocation in wireless communication systems. An environment that includes a base station, multiple antennas, …

Deep Reinforcement Learning rllib Scheduling

Optimal Resource Allocation in Wireless Control Systems via Deep Policy Gradient

2019-10-25

In wireless control systems, remote control of plants is achieved through closing of the control loop over a wireless channel. As wireless communication is noisy and subject to packet dropouts, proper allocation of limit…

Deep Reinforcement Learning Policy Gradient Methods