paper-with-me

홈 › Papers

Regularized Langevin Dynamics for Combinatorial Optimization

2025-02-01 · Shengyu Feng, Yiming Yang

This work proposes a simple yet effective sampling framework for combinatorial optimization (CO). Our method builds on discrete Langevin dynamics (LD), an efficient gradient-guided generative paradigm. However, we observe that directly applying LD often leads to limited exploration. To overcome this limitation, we propose the Regularized Langevin Dynamics (RLD), which enforces an expected distance between the sampled and current solutions, effectively avoiding local minima. We develop two CO solvers on top of RLD, one based on simulated annealing (SA), and the other one based on neural network (NN). Empirical results on three classic CO problems demonstrate that both of our methods can achieve comparable or better performance against the previous state-of-the-art (SOTA) SA- and NN-based solvers. In particular, our SA algorithm reduces the runtime of the previous SOTA SA method by up to 80\%, while achieving equal or superior performance. In summary, RLD offers a promising framework for enhancing both traditional heuristics and NN models to solve CO problems. Our code is available at https://github.com/Shengyu-Feng/RLD4CO.

📄 PDF Abstract BibTeX arXiv:2502.00277

Code (1)

shengyu-feng/rld4co 공식 구현 pytorch

Tasks

Combinatorial Optimization

Similar Papers 제목 키워드 기반

Mirror Mean-Field Langevin Dynamics

2025-05-05 · Anming Gu, Juno Kim

The mean-field Langevin dynamics (MFLD) minimizes an entropy-regularized nonlinear convex functional on the Wasserstein space over $\mathbb{R}^d$, and has gained attention recently as a model for the gradient descent dyn…

Mean-field Langevin dynamics: Time-space discretization, stochastic gradient, and variance reduction

2023-09-21 · NeurIPS 2023 11

The mean-field Langevin dynamics (MFLD) is a nonlinear generalization of the Langevin dynamics that incorporates a distribution-dependent drift, and it naturally arises from the optimization of two-layer neural networks …

Convergence of mean-field Langevin dynamics: Time and space discretization, stochastic gradient, and variance reduction

2023-06-12 · Taiji Suzuki, Denny Wu, Atsushi Nitanda

The mean-field Langevin dynamics (MFLD) is a nonlinear generalization of the Langevin dynamics that incorporates a distribution-dependent drift, and it naturally arises from the optimization of two-layer neural networks …

Convex Analysis of the Mean Field Langevin Dynamics

2022-01-25 · Atsushi Nitanda, Denny Wu, Taiji Suzuki

As an example of the nonlinear Fokker-Planck equation, the mean field Langevin dynamics recently attracts attention due to its connection to (noisy) gradient descent on infinitely wide neural networks in the mean field r…

Dimension-free convergence rates for gradient Langevin dynamics in RKHS

2020-02-29 · Boris Muzellec, Kanji Sato, Mathurin Massias, Taiji Suzuki

Gradient Langevin dynamics (GLD) and stochastic GLD (SGLD) have attracted considerable attention lately, as a way to provide convergence guarantees in a non-convex setting. However, the known rates grow exponentially wit…