paper-with-me

Papers

A Tutorial on Dual Decomposition and Lagrangian Relaxation for Inference in Natural Language Processing

2014-01-23 · Alexander M. Rush, Michael Collins

Dual decomposition, and more generally Lagrangian relaxation, is a classical method for combinatorial optimization; it has recently been applied to several inference problems in natural language processing (NLP). This tutorial gives an overview of the technique. We describe example algorithms, describe formal guarantees for the method, and describe practical issues in implementing the algorithms. While our examples are predominantly drawn from the NLP literature, the material should be of general relevance to inference problems in machine learning. A central theme of this tutorial is that Lagrangian relaxation is naturally applied in conjunction with a broad class of combinatorial algorithms, allowing inference in models that go significantly beyond previous work on Lagrangian relaxation for inference in graphical models.

📄 PDF Abstract BibTeX arXiv:1405.5208

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial Optimization

Similar Papers 제목 키워드 기반

Submodular relaxation for inference in Markov random fields

2015-01-15 · Anton Osokin, Dmitry Vetrov

In this paper we address the problem of finding the most probable state of a discrete Markov random field (MRF), also known as the MRF energy minimization problem. The task is known to be NP-hard in general and its pract…

Maximum a Posteriori Inference for Factor Graphs via Benders' Decomposition

2024-10-24 · Harsh Vardhan Dubey, Ji Ah Lee, Patrick Flaherty

Many Bayesian statistical inference problems come down to computing a maximum a-posteriori (MAP) assignment of latent variables. Yet, standard methods for estimating the MAP assignment do not have a finite time guarantee…

Zonotope Domains for Lagrangian Neural Network Verification

2022-10-14 · Matt Jordan, Jonathan Hayase, Alexandros G. Dimakis, Sewoong Oh

Neural network verification aims to provide provable bounds for the output of a neural network for a given input range. Notable prior works in this domain have either generated bounds using abstract domains, which preser…

Learning Valid Dual Bounds in Constraint Programming: Boosted Lagrangian Decomposition with Self-Supervised Learning

2024-08-22 · Swann Bessa, Darius Dabert, Max Bourgeat, Louis-Martin Rousseau 외

Lagrangian decomposition (LD) is a relaxation method that provides a dual bound for constrained optimization problems by decomposing them into more manageable sub-problems. This bound can be used in branch-and-bound algo…

Self-Supervised Learningvalid

Lagrangian Decomposition for Neural Network Verification

2020-02-24 · Rudy Bunel, Alessandro De Palma, Alban Desmaison, Krishnamurthy Dvijotham 외

A fundamental component of neural network verification is the computation of bounds on the values their outputs can take. Previous methods have either used off-the-shelf solvers, discarding the problem structure, or rela…

GPUvalid