paper-with-me

Papers

Deep Reinforcement Learning for Exact Combinatorial Optimization: Learning to Branch

2022-06-14 · Tianyu Zhang, Amin Banitalebi-Dehkordi, Yong Zhang

Branch-and-bound is a systematic enumerative method for combinatorial optimization, where the performance highly relies on the variable selection strategy. State-of-the-art handcrafted heuristic strategies suffer from relatively slow inference time for each selection, while the current machine learning methods require a significant amount of labeled data. We propose a new approach for solving the data labeling and inference latency issues in combinatorial optimization based on the use of the reinforcement learning (RL) paradigm. We use imitation learning to bootstrap an RL agent and then use Proximal Policy Optimization (PPO) to further explore global optimal actions. Then, a value network is used to run Monte-Carlo tree search (MCTS) to enhance the policy network. We evaluate the performance of our method on four different categories of combinatorial optimization problems and show that our approach performs strongly compared to the state-of-the-art machine learning and heuristics based methods.

📄 PDF Abstract BibTeX arXiv:2206.06965

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningCombinatorial OptimizationDeep Reinforcement LearningImitation Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Variable Selection

Methods 이 논문이 사용한 방법론

Monte-Carlo Tree Search Monte-Carlo Tree Search is a planning algorithm that accumulates value estimates obtained from Monte Carlo simulations in order to successively direct simulations towards more…

Similar Papers 제목 키워드 기반

Planning in Branch-and-Bound: Model-Based Reinforcement Learning for Exact Combinatorial Optimization

2025-11-12 · Paul Strang, Zacharie Alès, Côme Bissuel, Olivier Juan 외 arxiv

Mixed-Integer Linear Programming (MILP) lies at the core of many real-world combinatorial optimization (CO) problems, traditionally solved by branch-and-bound (B&B). A key driver influencing B&B solvers efficiency is the…

Reinforcement Learning

Exact Combinatorial Optimization with Graph Convolutional Neural Networks

2019-06-04 · NeurIPS 2019 12 · Maxime Gasse, Didier Chételat, Nicola Ferroni, Laurent Charlin 외

Combinatorial optimization problems are typically tackled by the branch-and-bound paradigm. We propose a new graph convolutional neural network model for learning branch-and-bound variable selection policies, which lever…

Combinatorial OptimizationImitation LearningVariable Selection

TreeDQN: Learning to minimize Branch-and-Bound tree

2023-06-09 · Dmitry Sorokin, Alexander Kostin

Combinatorial optimization problems require an exhaustive search to find the optimal solution. A convenient approach to solving combinatorial optimization tasks in the form of Mixed Integer Linear Programs is Branch-and-…

Combinatorial Optimizationreinforcement-learningReinforcement LearningVariable Selection

SeaPearl: A Constraint Programming Solver guided by Reinforcement Learning

2021-02-18 · Félix Chalumeau, Ilan Coulon, Quentin Cappart, Louis-Martin Rousseau

The design of efficient and generic algorithms for solving combinatorial optimization problems has been an active field of research for many years. Standard exact solving approaches are based on a clever and complete enu…

BIG-bench Machine LearningCombinatorial Optimizationreinforcement-learningReinforcement Learning+1

Exact Combinatorial Optimization with Temporo-Attentional Graph Neural Networks

2023-11-23 · Mehdi Seyfi, Amin Banitalebi-Dehkordi, Zirui Zhou, Yong Zhang

Combinatorial optimization finds an optimal solution within a discrete set of variables and constraints. The field has seen tremendous progress both in research and industry. With the success of deep learning in the past…

Combinatorial OptimizationGraph AttentionVariable Selection