Towards Optimal Environmental Policies: Policy Learning under Arbitrary Bipartite Network Interference

2024-10-10 · Raphael C. Kim, Falco J. Bargagli-Stoffi, Kevin L. Chen, Rachel C. Nethery

The substantial effect of air pollution on cardiovascular disease and mortality burdens is well-established. Emissions-reducing interventions on coal-fired power plants -- a major source of hazardous air pollution -- have proven to be an effective, but costly, strategy for reducing pollution-related health burdens. Targeting the power plants that achieve maximum health benefits while satisfying realistic cost constraints is challenging. The primary difficulty lies in quantifying the health benefits of intervening at particular plants. This is further complicated because interventions are applied on power plants, while health impacts occur in potentially distant communities, a setting known as bipartite network interference (BNI). In this paper, we introduce novel policy learning methods based on Q- and A-Learning to determine the optimal policy under arbitrary BNI. We derive asymptotic properties and demonstrate finite sample efficacy in simulations. We apply our novel methods to a comprehensive dataset of Medicare claims, power plant data, and pollution transport networks. Our goal is to determine the optimal strategy for installing power plant scrubbers to minimize ischemic heart disease (IHD) hospitalizations under various cost constraints. We find that annual IHD hospitalization rates could be reduced in a range from 20.66-44.51 per 10,000 person-years through optimal policies under different cost constraints.

📄 PDF Abstract BibTeX arXiv:2410.08362

Code (0)

등록된 구현이 없습니다.

Multi-Criteria Optimal Planning for Energy Policies in CLP

2014-05-15 · Marco Gavanelli, Stefano Bragaglia, Michela Milano, Federico Chesani 외

In the policy making process a number of disparate and diverse issues such as economic development, environmental aspects, as well as the social acceptance of the policy, need to be considered. A single person might not …

The Feasibility of Constrained Reinforcement Learning Algorithms: A Tutorial Study

2024-04-15 · Yujie Yang, Zhilong Zheng, Shengbo Eben Li, Masayoshi Tomizuka 외

Satisfying safety constraints is a priority concern when solving optimal control problems (OCPs). Due to the existence of infeasibility phenomenon, where a constraint-satisfying solution cannot be found, it is necessary …

Model Predictive Control reinforcement-learning Reinforcement Learning (RL)

Bounded Robustness in Reinforcement Learning via Lexicographic Objectives

2022-09-30 · Daniel Jarne Ornia, Licio Romao, Lewis Hammond, Manuel Mazo Jr. 외

Policy robustness in Reinforcement Learning may not be desirable at any cost: the alterations caused by robustness requirements from otherwise optimal policies should be explainable, quantifiable and formally verifiable.…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Highway Reinforcement Learning

2024-05-28 · Yuhui Wang, Miroslav Strupl, Francesco Faccio, Qingyuan Wu 외

Learning from multi-step off-policy data collected by a set of policies is a core problem of reinforcement learning (RL). Approaches based on importance sampling (IS) often suffer from large variances due to products of …

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Optimizing over a Restricted Policy Class in Markov Decision Processes

2018-02-26 · Ershad Banijamali, Yasin Abbasi-Yadkori, Mohammad Ghavamzadeh, Nikos Vlassis

We address the problem of finding an optimal policy in a Markov decision process under a restricted policy class defined by the convex hull of a set of base policies. This problem is of great interest in applications in …

Policy Gradient Methods