Scalable Decision Focused Learning via Online Trainable Surrogates
Decision support systems often rely on solving complex optimization problems that may require to estimate uncertain parameters beforehand. Recent studies have shown how using traditionally trained estimators for this task can lead to suboptimal solutions. Using the actual decision cost as a loss function (called Decision Focused Learning) can address this issue, but with a severe loss of scalability at training time. To address this issue, we propose an acceleration method based on replacing costly loss function evaluations with an efficient surrogate. Unlike previously defined surrogates, our approach relies on unbiased estimators reducing the risk of spurious local optima and can provide information on its local confidence allowing one to switch to a fallback method when needed. Furthermore, the surrogate is designed for a black-box setting, which enables compensating for simplifications in the optimization model and accounting for recourse actions during cost computation. In our results, the method reduces costly inner solver calls, with a solution quality comparable to other state-of-the-art techniques.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Dual Perspective on Decision-Focused Learning: Scalable Training via Dual-Guided Surrogates
Many real-world decisions are made under uncertainty by solving optimization problems using predicted quantities. This predict-then-optimize paradigm has motivated decision-focused learning, which trains models with awar…
Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses
Decision-Focused Learning (DFL) is a paradigm for tailoring a predictive model to a downstream optimization task that uses its predictions in order to perform better on that specific task. The main technical challenge as…
Decision MakingTowards Scalable Bayesian Optimization via Gradient-Informed Bayesian Neural Networks
Bayesian optimization (BO) is a widely used method for data-driven optimization that generally relies on zeroth-order data of objective function to construct probabilistic surrogate models. These surrogates guide the exp…
Bayesian OptimizationGaussian ProcessesA Methodology for Effective Surrogate Learning in Complex Optimization
Solving complex problems requires continuous effort in developing theory and practice to cope with larger, more difficult scenarios. Working with surrogates is normal for creating a proxy that realistically models the pr…
Operational risk quantification of power grids using graph neural network surrogates of the DC OPF
A DC OPF surrogate modeling framework is developed for Monte Carlo (MC) sampling-based risk quantification in power grid operation. MC simulation necessitates solving a large number of DC OPF problems corresponding to th…
Decision MakingGraph Neural Network