CVaR-based Safety Analysis in the Infinite Time Horizon Setting
We develop a risk-averse safety analysis method for stochastic systems on discrete infinite time horizons. Our method quantifies the notion of risk for a control system in terms of the severity of a harmful random outcome in a fraction of the worst cases. In contrast, classical methods quantify risk in terms of the probability of a harmful event. Our theoretical arguments are based on the analysis of a value iteration algorithm on an augmented state space. We provide conditions to guarantee the existence of an optimal policy on this space. We illustrate the method numerically using an example from the domain of stormwater management.
Code (1)
Tasks
ManagementSimilar Papers 제목 키워드 기반
Risk-Sensitive Markov Decision Processes with Long-Run CVaR Criterion
CVaR (Conditional Value at Risk) is a risk metric widely used in finance. However, dynamically optimizing CVaR is difficult since it is not a standard Markov decision process (MDP) and the principle of dynamic programmin…
ManagementSensitivityRisk-Constrained Belief-Space Optimization for Safe Control under Latent Uncertainty
Many safety-critical control systems operate under latent uncertainty that sensors cannot resolve at decision time. Such uncertainty, arising from unknown physical properties, disturbances, or unobserved geometry, affect…
Infinite Time Horizon Safety of Bayesian Neural Networks
Bayesian neural networks (BNNs) place distributions over the weights of a neural network to model uncertainty in the data and the network's prediction. We consider the problem of verifying safety when running a Bayesian …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Safe ExplorationInverse Optimal Safety Filters
CBF-QP safety filters are pointwise minimizers of the control effort at a given state vector, i.e., myopically optimal at each time instant. But are they optimal over the entire infinite time horizon? What does it even m…
Risk Estimation in a Markov Cost Process: Lower and Upper Bounds
We tackle the problem of estimating risk measures of the infinite-horizon discounted cost within a Markov cost process. The risk measures we study include variance, Value-at-Risk (VaR), and Conditional Value-at-Risk (CVa…