paper-with-me

Papers

Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses

2022-03-30 · Sanket Shah, Kai Wang, Bryan Wilder, Andrew Perrault, Milind Tambe

Decision-Focused Learning (DFL) is a paradigm for tailoring a predictive model to a downstream optimization task that uses its predictions in order to perform better on that specific task. The main technical challenge associated with DFL is that it requires being able to differentiate through the optimization problem, which is difficult due to discontinuous solutions and other challenges. Past work has largely gotten around this issue by handcrafting task-specific surrogates to the original optimization problem that provide informative gradients when differentiated through. However, the need to handcraft surrogates for each new task limits the usability of DFL. In addition, there are often no guarantees about the convexity of the resulting surrogates and, as a result, training a predictive model using them can lead to inferior local optima. In this paper, we do away with surrogates altogether and instead learn loss functions that capture task-specific information. To the best of our knowledge, ours is the first approach that entirely replaces the optimization component of decision-focused learning with a loss that is automatically learned. Our approach (a) only requires access to a black-box oracle that can solve the optimization problem and is thus generalizable, and (b) can be convex by construction and so can be easily optimized over. We evaluate our approach on three resource allocation problems from the literature and find that our approach outperforms learning without taking into account task structure in all three domains, and even hand-crafted surrogates from the literature.

📄 PDF Abstract BibTeX arXiv:2203.16067

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Differentiable Distributionally Robust Optimization Layers

2024-06-24 · Xutao Ma, Chao Ning, Wenli Du

In recent years, there has been a growing research interest in decision-focused learning, which embeds optimization problems as a layer in learning pipelines and demonstrates a superior performance than the prediction-fo…

Decision MakingDecision Making Under Uncertainty

Locally Convex Global Loss Network for Decision-Focused Learning

2024-03-04 · Haeun Jeon, Hyunglip Bae, Minsu Park, Chanyeong Kim 외

In decision-making problems under uncertainty, predicting unknown parameters is often considered independent of the optimization part. Decision-focused learning (DFL) is a task-oriented framework that integrates predicti…

Decision Making

Minimizing Surrogate Losses for Decision-Focused Learning using Differentiable Optimization

2025-08-15 · Jayanta Mandi, Ali İrfan Mahmutoğulları, Senne Berden, Tias Guns arxiv

Decision-focused learning (DFL) trains a machine learning (ML) model to predict parameters of an optimization problem, to directly minimize decision regret, i.e., maximize decision quality. Gradient-based DFL requires co…

Decision-Focused Forecasting: A Differentiable Multistage Optimisation Architecture

2024-05-23 · Egon Peršak, Miguel F. Anjos

Most decision-focused learning work has focused on single stage problems whereas many real-world decision problems are more appropriately modelled using multistage optimisation. In multistage problems contextual informat…

Decision MakingDecision Making Under Uncertainty

Learning with Differentiable Perturbed Optimizers

2020-02-20 · Quentin Berthet, Mathieu Blondel, Olivier Teboul, Marco Cuturi 외

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break…

Structured Prediction