paper-with-me

홈 › Papers

Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verification

2022-04-21 · Prithvi Akella, Anushri Dixit, Mohamadreza Ahmadi, Joel W. Burdick, Aaron D. Ames

The dramatic increase of autonomous systems subject to variable environments has given rise to the pressing need to consider risk in both the synthesis and verification of policies for these systems. This paper aims to address a few problems regarding risk-aware verification and policy synthesis, by first developing a sample-based method to bound the risk measure evaluation of a random variable whose distribution is unknown. These bounds permit us to generate high-confidence verification statements for a large class of robotic systems. Second, we develop a sample-based method to determine solutions to non-convex optimization problems that outperform a large fraction of the decision space of possible solutions. Both sample-based approaches then permit us to rapidly synthesize risk-aware policies that are guaranteed to achieve a minimum level of system performance. To showcase our approach in simulation, we verify a cooperative multi-agent system and develop a risk-aware controller that outperforms the system's baseline controller. We also mention how our approach can be extended to account for any $g$-entropic risk measure - the subset of coherent risk measures on which we focus.

📄 PDF Abstract BibTeX arXiv:2204.09833

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Regret Bounds for Risk-sensitive Reinforcement Learning with Lipschitz Dynamic Risk Measures

2023-06-04 · Hao Liang, Zhi-Quan Luo

We study finite episodic Markov decision processes incorporating dynamic risk measures to capture risk sensitivity. To this end, we present two model-based algorithms applied to \emph{Lipschitz} dynamic risk measures, a …

reinforcement-learningSensitivity

A Wasserstein distance approach for concentration of empirical risk estimates

2019-02-27 · NeurIPS 2019 12 · Prashanth L. A., Sanjay P. Bhat

This paper presents a unified approach based on Wasserstein distance to derive concentration bounds for empirical estimates for two broad classes of risk measures defined in the paper. The classes of risk measures introd…

Partial Law Invariance and Risk Measures

2024-01-30 · Yi Shen, Zachary Van Oosten, Ruodu Wang

We introduce the concept of partial law invariance, generalizing the concepts of law invariance and probabilistic sophistication widely used in decision theory, as well as statistical and financial applications. This new…

Decision MakingDecision Making Under UncertaintyManagement

Risk Estimation in a Markov Cost Process: Lower and Upper Bounds

2023-10-17 · Gugan Thoppe, L. A. Prashanth, Sanjay Bhat

We tackle the problem of estimating risk measures of the infinite-horizon discounted cost within a Markov cost process. The risk measures we study include variance, Value-at-Risk (VaR), and Conditional Value-at-Risk (CVa…

Optimal Transport Divergences induced by Scoring Functions

2023-11-20 · Silvana M. Pesenti, Steven Vanduffel

We employ scoring functions, used in statistics for eliciting risk functionals, as cost functions in the Monge-Kantorovich (MK) optimal transport problem. This gives raise to a rich variety of novel asymmetric MK diverge…