Unsupervised learning of noisy-or Bayesian networks

Yoni Halpern, David Sontag

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper considers the problem of learning the parameters in Bayesian networks of discrete variables with known structure and hidden variables. Previous approaches in these settings typically use expectation maximization; when the network has high treewidth, the required expectations might be approximated using Monte Carlo or variational methods. We show how to avoid inference altogether during learning by giving a polynomial-time algorithm based on the method-of-moments, building upon recent work on learning discrete-valued mixture models. In particular, we show how to learn the parameters for a family of bipartite noisy-or Bayesian networks. In our experimental results, we demonstrate an application of our algorithm to learning QMR-DT, a large Bayesian network used for medical diagnosis. We show that it is possible to fully learn the parameters of QMR-DT even when only the findings are observed in the training data (ground truth diseases unknown).

Original languageEnglish (US)
Title of host publicationUncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013
Pages272-281
Number of pages10
StatePublished - 2013
Event29th Conference on Uncertainty in Artificial Intelligence, UAI 2013 - Bellevue, WA, United States
Duration: Jul 11 2013Jul 15 2013

Other

Other29th Conference on Uncertainty in Artificial Intelligence, UAI 2013
CountryUnited States
CityBellevue, WA
Period7/11/137/15/13

Fingerprint

Unsupervised learning
Bayesian networks
Method of moments
Polynomials

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

Halpern, Y., & Sontag, D. (2013). Unsupervised learning of noisy-or Bayesian networks. In Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013 (pp. 272-281)

Unsupervised learning of noisy-or Bayesian networks. / Halpern, Yoni; Sontag, David.

Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013. 2013. p. 272-281.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Halpern, Y & Sontag, D 2013, Unsupervised learning of noisy-or Bayesian networks. in Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013. pp. 272-281, 29th Conference on Uncertainty in Artificial Intelligence, UAI 2013, Bellevue, WA, United States, 7/11/13.
Halpern Y, Sontag D. Unsupervised learning of noisy-or Bayesian networks. In Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013. 2013. p. 272-281
Halpern, Yoni ; Sontag, David. / Unsupervised learning of noisy-or Bayesian networks. Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013. 2013. pp. 272-281
@inproceedings{bf16bd1d481c4cf4a541ca84d6fa976b,
title = "Unsupervised learning of noisy-or Bayesian networks",
abstract = "This paper considers the problem of learning the parameters in Bayesian networks of discrete variables with known structure and hidden variables. Previous approaches in these settings typically use expectation maximization; when the network has high treewidth, the required expectations might be approximated using Monte Carlo or variational methods. We show how to avoid inference altogether during learning by giving a polynomial-time algorithm based on the method-of-moments, building upon recent work on learning discrete-valued mixture models. In particular, we show how to learn the parameters for a family of bipartite noisy-or Bayesian networks. In our experimental results, we demonstrate an application of our algorithm to learning QMR-DT, a large Bayesian network used for medical diagnosis. We show that it is possible to fully learn the parameters of QMR-DT even when only the findings are observed in the training data (ground truth diseases unknown).",
author = "Yoni Halpern and David Sontag",
year = "2013",
language = "English (US)",
pages = "272--281",
booktitle = "Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013",

}

TY - GEN

T1 - Unsupervised learning of noisy-or Bayesian networks

AU - Halpern, Yoni

AU - Sontag, David

PY - 2013

Y1 - 2013

N2 - This paper considers the problem of learning the parameters in Bayesian networks of discrete variables with known structure and hidden variables. Previous approaches in these settings typically use expectation maximization; when the network has high treewidth, the required expectations might be approximated using Monte Carlo or variational methods. We show how to avoid inference altogether during learning by giving a polynomial-time algorithm based on the method-of-moments, building upon recent work on learning discrete-valued mixture models. In particular, we show how to learn the parameters for a family of bipartite noisy-or Bayesian networks. In our experimental results, we demonstrate an application of our algorithm to learning QMR-DT, a large Bayesian network used for medical diagnosis. We show that it is possible to fully learn the parameters of QMR-DT even when only the findings are observed in the training data (ground truth diseases unknown).

AB - This paper considers the problem of learning the parameters in Bayesian networks of discrete variables with known structure and hidden variables. Previous approaches in these settings typically use expectation maximization; when the network has high treewidth, the required expectations might be approximated using Monte Carlo or variational methods. We show how to avoid inference altogether during learning by giving a polynomial-time algorithm based on the method-of-moments, building upon recent work on learning discrete-valued mixture models. In particular, we show how to learn the parameters for a family of bipartite noisy-or Bayesian networks. In our experimental results, we demonstrate an application of our algorithm to learning QMR-DT, a large Bayesian network used for medical diagnosis. We show that it is possible to fully learn the parameters of QMR-DT even when only the findings are observed in the training data (ground truth diseases unknown).

UR - http://www.scopus.com/inward/record.url?scp=84888163727&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84888163727&partnerID=8YFLogxK

M3 - Conference contribution

SP - 272

EP - 281

BT - Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013

ER -