paper-with-me

Papers

A residual-based message passing algorithm for constraint satisfaction problems

2022-02-25 · Chun-Yan Zhao, Yan-Rong Fu, Jin-Hua Zhao

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in tackling hard computational tasks in optimization, inference, and learning problems. In the context of constraint satisfaction problems (CSPs), when a control parameter (such as constraint density) is tuned, multiple threshold phenomena emerge, signaling fundamental structural transitions in their solution space. Finding solutions around these transition points is exceedingly challenging for algorithm design, where message passing algorithms suffer from a large message fluctuation far from convergence. Here we introduce a residual-based updating step into message passing algorithms, in which messages varying large between consecutive steps are given high priority in the updating process. For the specific example of model RB, a typical prototype of random CSPs with growing domains, we show that our algorithm improves the convergence of message updating and increases the success probability in finding solutions around the satisfiability threshold with a low computational cost. Our approach to message passing algorithms should be of value for exploring their power in developing algorithms to find ground-state solutions and understand the detailed structure of solution space of hard optimization problems.

📄 PDF Abstract BibTeX arXiv:2202.12468

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Improved Three-Weight Message-Passing Algorithm

2013-05-08 · Nate Derbinsky, José Bento, Veit Elser, Jonathan S. Yedidia

We describe how the powerful "Divide and Concur" algorithm for constraint satisfaction can be derived as a special case of a message-passing version of the Alternating Direction Method of Multipliers (ADMM) algorithm for…

Solving Constraint Satisfaction Problems through Belief Propagation-guided decimation

2007-09-11 · Andrea Montanari, Federico Ricci-Tersenghi, Guilhem Semerjian

Message passing algorithms have proved surprisingly successful in solving hard constraint satisfaction problems on sparse random graphs. In such applications, variables are fixed sequentially to satisfy the constraints. …

Perturbed Message Passing for Constraint Satisfaction Problems

2014-01-26 · Siamak Ravanbakhsh, Russell Greiner

We introduce an efficient message passing scheme for solving Constraint Satisfaction Problems (CSPs), which uses stochastic perturbation of Belief Propagation (BP) and Survey Propagation (SP) messages to bypass decimatio…

Survey

Performance of the Survey Propagation-guided decimation algorithm for the random NAE-K-SAT problem

2014-02-01 · David Gamarnik, Madhu Sudan

We show that the Survey Propagation-guided decimation algorithm fails to find satisfying assignments on random instances of the "Not-All-Equal-$K$-SAT" problem if the number of message passing iterations is bounded by a …

Clustering

On Coordinate Minimization of Convex Piecewise-Affine Functions

2017-09-14 · Tomas Werner

A popular class of algorithms to optimize the dual LP relaxation of the discrete energy minimization problem (a.k.a.\ MAP inference in graphical models or valued constraint satisfaction) are convergent message-passing al…