Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models

Benjamin Peherstorfer, Boris Kramer, Karen Willcox

Research output: Contribution to journalArticle

Abstract

In failure probability estimation, importance sampling constructs a biasing distribution that targets the failure event such that a small number of model evaluations is sufficient to achieve a Monte Carlo estimate of the failure probability with an acceptable accuracy; however, the construction of the biasing distribution often requires a large number of model evaluations, which can become computationally expensive. We present a mixed multifidelity importance sampling (MMFIS) approach that leverages computationally cheap but erroneous surrogate models for the construction of the biasing distribution and that uses the original high-fidelity model to guarantee unbiased estimates of the failure probability. The key property of our MMFIS estimator is that it can leverage multiple surrogate models for the construction of the biasing distribution, instead of a single surrogate model alone. We show that our MMFIS estimator has a mean-squared error that is up to a constant lower than the mean-squared errors of the corresponding estimators that uses any of the given surrogate models alone—even in settings where no information about the approximation qualities of the surrogate models is available. In particular, our MMFIS approach avoids the problem of selecting the surrogate model that leads to the estimator with the lowest mean-squared error, which is challenging if the approximation quality of the surrogate models is unknown. We demonstrate our MMFIS approach on numerical examples, where we achieve orders of magnitude speedups compared to using the high-fidelity model only.

Original languageEnglish (US)
Pages (from-to)61-75
Number of pages15
JournalJournal of Computational Physics
Volume341
DOIs
StatePublished - Jul 15 2017

Fingerprint

Importance sampling
sampling
estimators
evaluation
estimates
approximation

Keywords

  • Failure probability estimation
  • Model reduction
  • Multifidelity
  • Rare event simulation
  • Surrogate modeling
  • Uncertainty quantification

ASJC Scopus subject areas

  • Physics and Astronomy (miscellaneous)
  • Computer Science Applications

Cite this

Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models. / Peherstorfer, Benjamin; Kramer, Boris; Willcox, Karen.

In: Journal of Computational Physics, Vol. 341, 15.07.2017, p. 61-75.

Research output: Contribution to journalArticle

@article{28d2e62fbf4d47659c49cefdba4ffc04,
title = "Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models",
abstract = "In failure probability estimation, importance sampling constructs a biasing distribution that targets the failure event such that a small number of model evaluations is sufficient to achieve a Monte Carlo estimate of the failure probability with an acceptable accuracy; however, the construction of the biasing distribution often requires a large number of model evaluations, which can become computationally expensive. We present a mixed multifidelity importance sampling (MMFIS) approach that leverages computationally cheap but erroneous surrogate models for the construction of the biasing distribution and that uses the original high-fidelity model to guarantee unbiased estimates of the failure probability. The key property of our MMFIS estimator is that it can leverage multiple surrogate models for the construction of the biasing distribution, instead of a single surrogate model alone. We show that our MMFIS estimator has a mean-squared error that is up to a constant lower than the mean-squared errors of the corresponding estimators that uses any of the given surrogate models alone—even in settings where no information about the approximation qualities of the surrogate models is available. In particular, our MMFIS approach avoids the problem of selecting the surrogate model that leads to the estimator with the lowest mean-squared error, which is challenging if the approximation quality of the surrogate models is unknown. We demonstrate our MMFIS approach on numerical examples, where we achieve orders of magnitude speedups compared to using the high-fidelity model only.",
keywords = "Failure probability estimation, Model reduction, Multifidelity, Rare event simulation, Surrogate modeling, Uncertainty quantification",
author = "Benjamin Peherstorfer and Boris Kramer and Karen Willcox",
year = "2017",
month = "7",
day = "15",
doi = "10.1016/j.jcp.2017.04.012",
language = "English (US)",
volume = "341",
pages = "61--75",
journal = "Journal of Computational Physics",
issn = "0021-9991",
publisher = "Academic Press Inc.",

}

TY - JOUR

T1 - Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models

AU - Peherstorfer, Benjamin

AU - Kramer, Boris

AU - Willcox, Karen

PY - 2017/7/15

Y1 - 2017/7/15

N2 - In failure probability estimation, importance sampling constructs a biasing distribution that targets the failure event such that a small number of model evaluations is sufficient to achieve a Monte Carlo estimate of the failure probability with an acceptable accuracy; however, the construction of the biasing distribution often requires a large number of model evaluations, which can become computationally expensive. We present a mixed multifidelity importance sampling (MMFIS) approach that leverages computationally cheap but erroneous surrogate models for the construction of the biasing distribution and that uses the original high-fidelity model to guarantee unbiased estimates of the failure probability. The key property of our MMFIS estimator is that it can leverage multiple surrogate models for the construction of the biasing distribution, instead of a single surrogate model alone. We show that our MMFIS estimator has a mean-squared error that is up to a constant lower than the mean-squared errors of the corresponding estimators that uses any of the given surrogate models alone—even in settings where no information about the approximation qualities of the surrogate models is available. In particular, our MMFIS approach avoids the problem of selecting the surrogate model that leads to the estimator with the lowest mean-squared error, which is challenging if the approximation quality of the surrogate models is unknown. We demonstrate our MMFIS approach on numerical examples, where we achieve orders of magnitude speedups compared to using the high-fidelity model only.

AB - In failure probability estimation, importance sampling constructs a biasing distribution that targets the failure event such that a small number of model evaluations is sufficient to achieve a Monte Carlo estimate of the failure probability with an acceptable accuracy; however, the construction of the biasing distribution often requires a large number of model evaluations, which can become computationally expensive. We present a mixed multifidelity importance sampling (MMFIS) approach that leverages computationally cheap but erroneous surrogate models for the construction of the biasing distribution and that uses the original high-fidelity model to guarantee unbiased estimates of the failure probability. The key property of our MMFIS estimator is that it can leverage multiple surrogate models for the construction of the biasing distribution, instead of a single surrogate model alone. We show that our MMFIS estimator has a mean-squared error that is up to a constant lower than the mean-squared errors of the corresponding estimators that uses any of the given surrogate models alone—even in settings where no information about the approximation qualities of the surrogate models is available. In particular, our MMFIS approach avoids the problem of selecting the surrogate model that leads to the estimator with the lowest mean-squared error, which is challenging if the approximation quality of the surrogate models is unknown. We demonstrate our MMFIS approach on numerical examples, where we achieve orders of magnitude speedups compared to using the high-fidelity model only.

KW - Failure probability estimation

KW - Model reduction

KW - Multifidelity

KW - Rare event simulation

KW - Surrogate modeling

KW - Uncertainty quantification

UR - http://www.scopus.com/inward/record.url?scp=85017470466&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017470466&partnerID=8YFLogxK

U2 - 10.1016/j.jcp.2017.04.012

DO - 10.1016/j.jcp.2017.04.012

M3 - Article

VL - 341

SP - 61

EP - 75

JO - Journal of Computational Physics

JF - Journal of Computational Physics

SN - 0021-9991

ER -