paper-with-me

Papers

DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problems

2024-06-28 · Kexiong Yu, Hang Zhao, Yuhang Huang, Renjiao Yi, Kai Xu, Chenyang Zhu

Combinatorial Optimization (CO) problems are fundamentally important in numerous real-world applications across diverse industries, characterized by entailing enormous solution space and demanding time-sensitive response. Despite recent advancements in neural solvers, their limited expressiveness struggles to capture the multi-modal nature of CO landscapes. While some research has shifted towards diffusion models, these models still sample solutions indiscriminately from the entire NP-complete solution space with time-consuming denoising processes, which limit their practicality for large problem scales. We propose DISCO, an efficient DIffusion Solver for large-scale Combinatorial Optimization problems that excels in both solution quality and inference speed. DISCO's efficacy is twofold: First, it enhances solution quality by constraining the sampling space to a more meaningful domain guided by solution residues, while preserving the multi-modal properties of the output distributions. Second, it accelerates the denoising process through an analytically solvable approach, enabling solution sampling with minimal reverse-time steps and significantly reducing inference time. DISCO delivers strong performance on large-scale Traveling Salesman Problems and challenging Maximal Independent Set benchmarks, with inference time up to 5.28 times faster than other diffusion alternatives. By incorporating a divide-and-conquer strategy, DISCO can well generalize to solve unseen-scale problem instances, even surpassing models specifically trained for those scales.

📄 PDF Abstract BibTeX arXiv:2406.19705

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial OptimizationDenoising

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Unsupervised Diffusion Solver for Combinatorial Optimization via Combinatorial Adjoint Matching

2026-05-29 · Shengyu Feng, Tarun Suresh, Yiming Yang arxiv

Diffusion-based neural solvers have shown strong promise for combinatorial optimization (CO), but existing methods typically rely on supervised training with large collections of near-optimal solutions. In this work, we …

Efficient Combinatorial Optimization via Heat Diffusion

2024-03-13 · Hengyuan Ma, Wenlian Lu, Jianfeng Feng

Combinatorial optimization problems are widespread but inherently challenging due to their discrete nature. The primary limitation of existing methods is that they can only access a small fraction of the solution space a…

Combinatorial Optimization

DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimization

2023-02-16 · NeurIPS 2023 11 · Zhiqing Sun, Yiming Yang

Neural network-based Combinatorial Optimization (CO) methods have shown promising results in solving various NP-complete (NPC) problems without relying on hand-crafted domain knowledge. This paper broadens the current sc…

Combinatorial OptimizationDenoisingTraveling Salesman Problem

A General Framework for Evaluating Robustness of Combinatorial Optimization Solvers on Graphs

2021-12-28 · Han Lu, Zenan Li, Runzhong Wang, Qibing Ren 외

Solving combinatorial optimization (CO) on graphs is among the fundamental tasks for upper-stream applications in data mining, machine learning and operations research. Despite the inherent NP-hard challenge for CO, heur…

Adversarial AttackCombinatorial Optimization

Latent Spherical Flow Policy for Reinforcement Learning with Combinatorial Actions

2026-01-29 · Lingkai Kong, Anagha Satish, Hezi Jiang, Akseli Kangaslahti 외 arxiv

Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization…

Reinforcement Learning