Smart Predict-and-Optimize for Hard Combinatorial Optimization Problems
Combinatorial optimization assumes that all parameters of the optimization problem, e.g. the weights in the objective function is fixed. Often, these weights are mere estimates and increasingly machine learning techniques are used to for their estimation. Recently, Smart Predict and Optimize (SPO) has been proposed for problems with a linear objective function over the predictions, more specifically linear programming problems. It takes the regret of the predictions on the linear problem into account, by repeatedly solving it during learning. We investigate the use of SPO to solve more realistic discrete optimization problems. The main challenge is the repeated solving of the optimization problem. To this end, we investigate ways to relax the problem as well as warmstarting the learning and the solving. Our results show that even for discrete problems it often suffices to train by solving the relaxation in the SPO loss. Furthermore, this approach outperforms, for most instances, the state-of-the-art approach of Wilder, Dilkina, and Tambe. We experiment with weighted knapsack problems as well as complex scheduling problems and show for the first time that a predict-and-optimize approach can successfully be used on large-scale combinatorial optimization problems.
Code (1)
Tasks
Combinatorial OptimizationSchedulingSimilar Papers 제목 키워드 기반
Divide and Learn: A Divide and Conquer Approach for Predict+Optimize
The predict+optimize problem combines machine learning ofproblem coefficients with a combinatorial optimization prob-lem that uses the predicted coefficients. While this problemcan be solved in two separate stages, it is…
Combinatorial OptimizationNeural Combinatorial Optimization with Reinforcement Learning
This paper presents a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent network that, given a…
Combinatorial Optimizationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1A Bi-Level Framework for Learning to Solve Combinatorial Optimization on Graphs
Combinatorial Optimization (CO) has been a long-standing challenging research topic featured by its NP-hard nature. Traditionally such problems are approximately solved with heuristic algorithms which are usually fast bu…
Combinatorial OptimizationSchedulingAutomatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
Combinatorial optimization problems with parameters to be predicted from side information are commonly seen in a variety of problems during the paradigm shift from reactive decision making to proactive decision making. D…
Combinatorial OptimizationDecision MakingPredictionA random-key GRASP for combinatorial optimization
This paper proposes a problem-independent GRASP metaheuristic using the random-key optimizer (RKO) paradigm. GRASP (greedy randomized adaptive search procedure) is a metaheuristic for combinatorial optimization that repe…
Combinatorial OptimizationDecodergraph partitioningTraveling Salesman Problem