paper-with-me

Papers

Deep Symbolic Optimization for Combinatorial Optimization: Accelerating Node Selection by Discovering Potential Heuristics

2024-06-14 · Hongyu Liu, Haoyang Liu, Yufei Kuang, Jie Wang, Bin Li

Combinatorial optimization (CO) is one of the most fundamental mathematical models in real-world applications. Traditional CO solvers, such as Branch-and-Bound (B&B) solvers, heavily rely on expert-designed heuristics, which are reliable but require substantial manual tuning. Recent studies have leveraged deep learning (DL) models as an alternative to capture rich feature patterns for improved performance on GPU machines. Nonetheless, the drawbacks of high training and inference costs, as well as limited interpretability, severely hinder the adoption of DL methods in real-world applications. To address these challenges, we propose a novel deep symbolic optimization learning framework that combines their advantages. Specifically, we focus on the node selection module within B&B solvers -- namely, deep symbolic optimization for node selection (Dso4NS). With data-driven approaches, Dso4NS guides the search for mathematical expressions within the high-dimensional discrete symbolic space and then incorporates the highest-performing mathematical expressions into a solver. The data-driven model captures the rich feature information in the input data and generates symbolic expressions, while the expressions deployed in solvers enable fast inference with high interpretability. Experiments demonstrate the effectiveness of Dso4NS in learning high-quality expressions, outperforming existing approaches on a CPU machine. Encouragingly, the learned CPU-based policies consistently achieve performance comparable to state-of-the-art GPU-based approaches.

📄 PDF Abstract BibTeX arXiv:2406.09740

Code (1)

sayal-k/dso4ns 공식 구현

Tasks

Combinatorial OptimizationCPUGPU

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

GRASP: Accelerating Shortest Path Attacks via Graph Attention

2023-10-12 · Zohair Shafi, Benjamin A. Miller, Ayan Chatterjee, Tina Eliassi-Rad 외

Recent advances in machine learning (ML) have shown promise in aiding and accelerating classical combinatorial optimization algorithms. ML-based speed ups that aim to learn in an end to end manner (i.e., directly output …

Combinatorial OptimizationGraph Attention

Multi-Modal Learning meets Genetic Programming: Analyzing Alignment in Latent Space Optimization

2026-04-09 · Benjamin Léger, Kazem Meidani, Christian Gagné arxiv

Symbolic regression (SR) aims to discover mathematical expressions from data, a task traditionally tackled using Genetic Programming (GP) through combinatorial search over symbolic structures. Latent Space Optimization (…

Bayesian Optimization of Functions over Node Subsets in Graphs

2024-05-24 · Huidong Liang, Xingchen Wan, Xiaowen Dong

We address the problem of optimizing over functions defined on node subsets in a graph. The optimization of such functions is often a non-trivial task given their combinatorial, black-box and expensive-to-evaluate nature…

Bayesian OptimizationCombinatorial Optimization

DRAGON: LLM-Driven Decomposition and Reconstruction Agents for Large-Scale Combinatorial Optimization

2026-01-10 · Shengkai Chen, Zhiguang Cao, Jianan Zhou, Yaoxin Wu 외 arxiv

Large Language Models (LLMs) have recently shown promise in addressing combinatorial optimization problems (COPs) through prompt-based strategies. However, their scalability and generalization remain limited, and their e…

Understanding Boolean Function Learnability on Deep Neural Networks: PAC Learning Meets Neurosymbolic Models

2020-09-13 · Marcio Nicolau, Anderson R. Tavares, Zhiwei Zhang, Pedro Avelar 외

Computational learning theory states that many classes of boolean formulas are learnable in polynomial time. This paper addresses the understudied subject of how, in practice, such formulas can be learned by deep neural …

Combinatorial OptimizationLearning TheoryPAC learning