Tightening LP relaxations for MAP using message passing

David Sontag, Talya Meltzer, Amir Globerson, Tommi Jaakkola, Yair Weiss

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Linear Programming (LP) relaxations have become powerful tools for finding the most probable (MAP) configuration in graphical models. These relaxations can be solved efficiently using message-passing algorithms such as belief propagation and, when the relaxation is tight, provably find the MAP configuration. The standard LP relaxation is not tight enough in many real-world problems, however, and this has lead to the use of higher order cluster-based LP relaxations. The computational cost increases exponentially with the size of the clusters and limits the number and type of clusters we can use. We propose to solve the cluster selection problem monotonically in the dual LP, iteratively selecting clusters with guaranteed improvement, and quickly re-solving with the added clusters by reusing the existing solution. Our dual message-passing algorithm finds the MAP configuration in protein sidechain placement, protein design, and stereo problems, in cases where the standard LP relaxation fails.

Original languageEnglish (US)
Title of host publicationProceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008
Pages503-510
Number of pages8
StatePublished - 2008
Event24th Conference on Uncertainty in Artificial Intelligence, UAI 2008 - Helsinki, Finland
Duration: Jul 9 2008Jul 12 2008

Other

Other24th Conference on Uncertainty in Artificial Intelligence, UAI 2008
CountryFinland
CityHelsinki
Period7/9/087/12/08

Fingerprint

Message passing
Linear programming
Proteins
Costs

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Sontag, D., Meltzer, T., Globerson, A., Jaakkola, T., & Weiss, Y. (2008). Tightening LP relaxations for MAP using message passing. In Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008 (pp. 503-510)

Tightening LP relaxations for MAP using message passing. / Sontag, David; Meltzer, Talya; Globerson, Amir; Jaakkola, Tommi; Weiss, Yair.

Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008. 2008. p. 503-510.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sontag, D, Meltzer, T, Globerson, A, Jaakkola, T & Weiss, Y 2008, Tightening LP relaxations for MAP using message passing. in Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008. pp. 503-510, 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008, Helsinki, Finland, 7/9/08.
Sontag D, Meltzer T, Globerson A, Jaakkola T, Weiss Y. Tightening LP relaxations for MAP using message passing. In Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008. 2008. p. 503-510
Sontag, David ; Meltzer, Talya ; Globerson, Amir ; Jaakkola, Tommi ; Weiss, Yair. / Tightening LP relaxations for MAP using message passing. Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008. 2008. pp. 503-510
@inproceedings{aad1d028d27f47768ce244ac0912ae8f,
title = "Tightening LP relaxations for MAP using message passing",
abstract = "Linear Programming (LP) relaxations have become powerful tools for finding the most probable (MAP) configuration in graphical models. These relaxations can be solved efficiently using message-passing algorithms such as belief propagation and, when the relaxation is tight, provably find the MAP configuration. The standard LP relaxation is not tight enough in many real-world problems, however, and this has lead to the use of higher order cluster-based LP relaxations. The computational cost increases exponentially with the size of the clusters and limits the number and type of clusters we can use. We propose to solve the cluster selection problem monotonically in the dual LP, iteratively selecting clusters with guaranteed improvement, and quickly re-solving with the added clusters by reusing the existing solution. Our dual message-passing algorithm finds the MAP configuration in protein sidechain placement, protein design, and stereo problems, in cases where the standard LP relaxation fails.",
author = "David Sontag and Talya Meltzer and Amir Globerson and Tommi Jaakkola and Yair Weiss",
year = "2008",
language = "English (US)",
isbn = "0974903949",
pages = "503--510",
booktitle = "Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008",

}

TY - GEN

T1 - Tightening LP relaxations for MAP using message passing

AU - Sontag, David

AU - Meltzer, Talya

AU - Globerson, Amir

AU - Jaakkola, Tommi

AU - Weiss, Yair

PY - 2008

Y1 - 2008

N2 - Linear Programming (LP) relaxations have become powerful tools for finding the most probable (MAP) configuration in graphical models. These relaxations can be solved efficiently using message-passing algorithms such as belief propagation and, when the relaxation is tight, provably find the MAP configuration. The standard LP relaxation is not tight enough in many real-world problems, however, and this has lead to the use of higher order cluster-based LP relaxations. The computational cost increases exponentially with the size of the clusters and limits the number and type of clusters we can use. We propose to solve the cluster selection problem monotonically in the dual LP, iteratively selecting clusters with guaranteed improvement, and quickly re-solving with the added clusters by reusing the existing solution. Our dual message-passing algorithm finds the MAP configuration in protein sidechain placement, protein design, and stereo problems, in cases where the standard LP relaxation fails.

AB - Linear Programming (LP) relaxations have become powerful tools for finding the most probable (MAP) configuration in graphical models. These relaxations can be solved efficiently using message-passing algorithms such as belief propagation and, when the relaxation is tight, provably find the MAP configuration. The standard LP relaxation is not tight enough in many real-world problems, however, and this has lead to the use of higher order cluster-based LP relaxations. The computational cost increases exponentially with the size of the clusters and limits the number and type of clusters we can use. We propose to solve the cluster selection problem monotonically in the dual LP, iteratively selecting clusters with guaranteed improvement, and quickly re-solving with the added clusters by reusing the existing solution. Our dual message-passing algorithm finds the MAP configuration in protein sidechain placement, protein design, and stereo problems, in cases where the standard LP relaxation fails.

UR - http://www.scopus.com/inward/record.url?scp=80053283534&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053283534&partnerID=8YFLogxK

M3 - Conference contribution

SN - 0974903949

SN - 9780974903941

SP - 503

EP - 510

BT - Proceedings of the 24th Conference on Uncertainty in Artificial Intelligence, UAI 2008

ER -