(Machine) Learning What Policies Value

2022-06-01 · Daniel Björkegren, Joshua E. Blumenstock, Samsun Knight

When a policy prioritizes one person over another, is it because they benefit more, or because they are preferred? This paper develops a method to uncover the values consistent with observed allocation decisions. We use machine learning methods to estimate how much each individual benefits from an intervention, and then reconcile its allocation with (i) the welfare weights assigned to different people; (ii) heterogeneous treatment effects of the intervention; and (iii) weights on different outcomes. We demonstrate this approach by analyzing Mexico's PROGRESA anti-poverty program. The analysis reveals that while the program prioritized certain subgroups -- such as indigenous households -- the fact that those groups benefited more implies that they were in fact assigned a lower welfare weight. The PROGRESA case illustrates how the method makes it possible to audit existing policies, and to design future policies that better align with values.

📄 PDF Abstract BibTeX arXiv:2206.00727

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Time After Time: Deep-Q Effect Estimation for Interventions on When and What to do

2025-03-20 · Yoav Wald, Mark Goldstein, Yonathan Efroni, Wouter A. C. van Amsterdam 외

Problems in fields such as healthcare, robotics, and finance requires reasoning about the value both of what decision or action to take and when to take it. The prevailing hope is that artificial intelligence will suppor…

What About Inputing Policy in Value Function: Policy Representation and Policy-extended Value Function Approximator

2020-10-19 · NeurIPS 2021 12 · Hongyao Tang, Zhaopeng Meng, Jianye Hao, Chen Chen 외

We study Policy-extended Value Function Approximator (PeVFA) in Reinforcement Learning (RL), which extends conventional value function approximator (VFA) to take as input not only the state (and action) but also an expli…

continuous-control Continuous Control Contrastive Learning OpenAI Gym+2

What is the Solution for State-Adversarial Multi-Agent Reinforcement Learning?

2022-12-06 · Songyang Han, Sanbao Su, Sihong He, Shuo Han 외

Various methods for Multi-Agent Reinforcement Learning (MARL) have been developed with the assumption that agents' policies are based on accurate state information. However, policies learned through Deep Reinforcement Le…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

What is the Value of Censored Data? An Exact Analysis for the Data-driven Newsvendor

2026-02-18 · Rachitesh Kumar, Omar Mouchtaki arxiv

We study the offline data-driven newsvendor problem with censored demand data. In contrast to prior works where demand is fully observed, we consider the setting where demand is censored at the inventory level and only s…

Fitted Q-iteration in continuous action-space MDPs

2007-12-01 · NeurIPS 2007 12 · András Antos, Csaba Szepesvári, Rémi Munos

We consider continuous state, continuous action batch reinforcement learning where the goal is to learn a good policy from a sufficiently rich trajectory generated by another policy. We study a variant of fitted Q-iterat…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)