paper-with-me

홈 › Papers

Towards graph neural networks for provably solving convex optimization problems

2025-02-04 · Chendi Qian, Christopher Morris

Recently, message-passing graph neural networks (MPNNs) have shown potential for solving combinatorial and continuous optimization problems due to their ability to capture variable-constraint interactions. While existing approaches leverage MPNNs to approximate solutions or warm-start traditional solvers, they often lack guarantees for feasibility, particularly in convex optimization settings. Here, we propose an iterative MPNN framework to solve convex optimization problems with provable feasibility guarantees. First, we demonstrate that MPNNs can provably simulate standard interior-point methods for solving quadratic problems with linear constraints, covering relevant problems such as SVMs. Secondly, to ensure feasibility, we introduce a variant that starts from a feasible point and iteratively restricts the search within the feasible region. Experimental results show that our approach outperforms existing neural baselines in solution quality and feasibility, generalizes well to unseen problem sizes, and, in some cases, achieves faster solution times than state-of-the-art solvers such as Gurobi.

📄 PDF Abstract BibTeX arXiv:2502.02446

Code (1)

chendiqian/feasmpnn 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

MPNN There are at least eight notable examples of models from the literature that can be described using the Message Passing Neural Networks (MPNN) framework. For simplicity we…

Similar Papers 제목 키워드 기반

The Sound of APALM Clapping: Faster Nonsmooth Nonconvex Optimization with Stochastic Asynchronous PALM

2016-12-01 · NeurIPS 2016 12 · Damek Davis, Brent Edmunds, Madeleine Udell

We introduce the Stochastic Asynchronous Proximal Alternating Linearized Minimization (SAPALM) method, a block coordinate stochastic proximal-gradient method for solving nonconvex, nonsmooth optimization problems. SAPALM…

Convergence Guarantees for the DeepWalk Embedding on Block Models

2024-10-26 · Christopher Harker, Aditya Bhaskara

Graph embeddings have emerged as a powerful tool for understanding the structure of graphs. Unlike classical spectral methods, recent methods such as DeepWalk, Node2Vec, etc. are based on solving nonlinear optimization p…

Stochastic Block Model

On Graduated Optimization for Stochastic Non-Convex Problems

2015-03-12 · Elad Hazan, Kfir. Y. Levy, Shai Shalev-Shwartz

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very litt…

Accelerated Algorithms for Convex and Non-Convex Optimization on Manifolds

2020-10-18 · Lizhen Lin, Bayan Saparbayeva, Michael Minyi Zhang, David B. Dunson

We propose a general scheme for solving convex and non-convex optimization problems on manifolds. The central idea is that, by adding a multiple of the squared retraction distance to the objective function in question, w…

Improving Stochastic Cubic Newton with Momentum

2024-10-25 · El Mahdi Chayti, Nikita Doikov, Martin Jaggi

We study stochastic second-order methods for solving general non-convex optimization problems. We propose using a special version of momentum to stabilize the stochastic gradient and Hessian estimates in Newton's method.…

Second-order methods