paper-with-me

홈 › Papers

A fast algorithm to minimize prediction loss of the optimal solution in inverse optimization problem of MILP

2024-05-23 · Akira Kitaoka

We consider the inverse optimization problem of estimating the weights of the objective function such that the given solution is an optimal solution for a mixed integer linear program (MILP). In this inverse optimization problem, the known methods exhibit inefficient convergence. Specifically, if $d$ denotes the dimension of the weights and $k$ the number of iterations, then the error of the weights is bounded by $O(k^{-1/(d-1)})$, leading to slow convergence as $d$ increases. We propose a projected subgradient method with a step size of $k^{-1/2}$ based on suboptimality loss. We theoretically show and demonstrate that the proposed method efficiently learns the weights. In particular, we show that there exists a constant $\gamma > 0$ such that the distance between the learned and true weights is bounded by $ O\left(k^{-1/(1+\gamma)} \exp\left(-\frac{\gamma k^{1/2}}{2+\gamma}\right)\right), $ or the optimal solution is exactly recovered. Furthermore, experiments demonstrate that the proposed method solves the inverse optimization problems of MILP using fewer than $1/7$ the number of MILP calls required by known methods, and converges within a finite number of iterations.

📄 PDF Abstract BibTeX arXiv:2405.14273

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Similar Papers 제목 키워드 기반

Learning Effective Loss Functions Efficiently

2019-06-28 · Matthew Streeter

We consider the problem of learning a loss function which, when minimized over a training dataset, yields a model that approximately minimizes a validation error metric. Though learning an optimal loss function is NP-har…

On the Rates of Convergence from Surrogate Risk Minimizers to the Bayes Optimal Classifier

2018-02-11 · Jingwei Zhang, Tongliang Liu, DaCheng Tao

We study the rates of convergence from empirical surrogate risk minimizers to the Bayes optimal classifier. Specifically, we introduce the notion of \emph{consistency intensity} to characterize a surrogate loss function …

Optimal Decision-Making Based on Prediction Sets

2026-02-01 · Tao Wang, Edgar Dobriban arxiv

Prediction sets can wrap around any ML model to cover unknown test outcomes with a guaranteed probability. Yet, it remains unclear how to use them optimally for downstream decision-making. Here, we propose a decision-the…

Medical Diagnosis

Sparse learning of maximum likelihood model for optimization of complex loss function

2015-11-18 · Ning Zhang, Prathamesh Chandrasekar

Traditional machine learning methods usually minimize a simple loss function to learn a predictive model, and then use a complex performance measure to measure the prediction performance. However, minimizing a simple los…

image-classificationImage ClassificationSparse Learning

Generalized Mixability via Entropic Duality

2014-06-24 · Mark D. Reid, Rafael M. Frongillo, Robert C. Williamson, Nishant Mehta

Mixability is a property of a loss which characterizes when fast convergence is possible in the game of prediction with expert advice. We show that a key property of mixability generalizes, and the exp and log operations…