A-Optimal design of experiments for infinite-dimensional Bayesian linear inverse problems with regularized l0-Sparsification

Alen Alexanderian, Noemi Petra, Georg Stadler, Omar Ghattas

Research output: Contribution to journalArticle

Abstract

We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the location of sensors (at which observational data are collected) to minimize the uncertainty in the parameters estimated by solving the inverse problem, where the uncertainty is expressed by the trace of the posterior covariance. Computing optimal experimental designs (OEDs) is particularly challenging for inverse problems governed by computationally expensive PDE models with infinite-dimensional (or, after discretization, high-dimensional) parameters. To alleviate the computational cost, we exploit the problem structure and build a low-rank approximation of the parameter-to-observable map, preconditioned with the square root of the prior covariance operator. The availability of this low-rank surrogate, relieves our method from expensive PDE solves when evaluating the optimal experimental design objective function, i.e., the trace of the posterior covariance, and its derivatives. Moreover, we employ a randomized trace estimator for efficient evaluation of the OED objective function. We control the sparsity of the sensor configuration by employing a sequence of penalty functions that successively approximate the l0-"norm"; this results in binary designs that characterize optimal sensor locations. We present numerical results for inference of the initial condition from spatiotemporal observations in a time-dependent advection-diffusion problem in two and three space dimensions. We find that an optimal design can be computed at a cost, measured in number of forward PDE solves, that is independent of the parameter and sensor dimensions. Moreover, the numerical optimization problem for finding the optimal design can be solved in a number of interior-point quasi-Newton iterations that is insensitive to the parameter and sensor dimensions. We demonstrate numerically that l0-sparsified experimental designs obtained via a continuation method outperform l1-sparsified designs.

Original languageEnglish (US)
Pages (from-to)A2122-A2148
JournalSIAM Journal on Scientific Computing
Volume36
Issue number5
DOIs
StatePublished - 2014

Fingerprint

A-optimal Design
Linear Inverse Problems
Optimal Experimental Design
Inverse problems
Design of experiments
Partial differential equations
Sensor
Partial differential equation
Sensors
Trace
Experiment
Inverse Problem
Objective function
Covariance Operator
Low-rank Approximation
Uncertainty
Quasi-Newton
Advection-diffusion
Continuation Method
Newton Iteration

Keywords

  • A-optimal design
  • Bayesian inference
  • Ill-posed inverse problems
  • Low-rank approximation
  • Optimal experimental design
  • Randomized SVD
  • Randomized trace estimator
  • Sensor placement

ASJC Scopus subject areas

  • Applied Mathematics
  • Computational Mathematics

Cite this

A-Optimal design of experiments for infinite-dimensional Bayesian linear inverse problems with regularized l0-Sparsification. / Alexanderian, Alen; Petra, Noemi; Stadler, Georg; Ghattas, Omar.

In: SIAM Journal on Scientific Computing, Vol. 36, No. 5, 2014, p. A2122-A2148.

Research output: Contribution to journalArticle

@article{9efbf970c39a4b60835510a323f78391,
title = "A-Optimal design of experiments for infinite-dimensional Bayesian linear inverse problems with regularized l0-Sparsification",
abstract = "We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the location of sensors (at which observational data are collected) to minimize the uncertainty in the parameters estimated by solving the inverse problem, where the uncertainty is expressed by the trace of the posterior covariance. Computing optimal experimental designs (OEDs) is particularly challenging for inverse problems governed by computationally expensive PDE models with infinite-dimensional (or, after discretization, high-dimensional) parameters. To alleviate the computational cost, we exploit the problem structure and build a low-rank approximation of the parameter-to-observable map, preconditioned with the square root of the prior covariance operator. The availability of this low-rank surrogate, relieves our method from expensive PDE solves when evaluating the optimal experimental design objective function, i.e., the trace of the posterior covariance, and its derivatives. Moreover, we employ a randomized trace estimator for efficient evaluation of the OED objective function. We control the sparsity of the sensor configuration by employing a sequence of penalty functions that successively approximate the l0-{"}norm{"}; this results in binary designs that characterize optimal sensor locations. We present numerical results for inference of the initial condition from spatiotemporal observations in a time-dependent advection-diffusion problem in two and three space dimensions. We find that an optimal design can be computed at a cost, measured in number of forward PDE solves, that is independent of the parameter and sensor dimensions. Moreover, the numerical optimization problem for finding the optimal design can be solved in a number of interior-point quasi-Newton iterations that is insensitive to the parameter and sensor dimensions. We demonstrate numerically that l0-sparsified experimental designs obtained via a continuation method outperform l1-sparsified designs.",
keywords = "A-optimal design, Bayesian inference, Ill-posed inverse problems, Low-rank approximation, Optimal experimental design, Randomized SVD, Randomized trace estimator, Sensor placement",
author = "Alen Alexanderian and Noemi Petra and Georg Stadler and Omar Ghattas",
year = "2014",
doi = "10.1137/130933381",
language = "English (US)",
volume = "36",
pages = "A2122--A2148",
journal = "SIAM Journal of Scientific Computing",
issn = "1064-8275",
publisher = "Society for Industrial and Applied Mathematics Publications",
number = "5",

}

TY - JOUR

T1 - A-Optimal design of experiments for infinite-dimensional Bayesian linear inverse problems with regularized l0-Sparsification

AU - Alexanderian, Alen

AU - Petra, Noemi

AU - Stadler, Georg

AU - Ghattas, Omar

PY - 2014

Y1 - 2014

N2 - We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the location of sensors (at which observational data are collected) to minimize the uncertainty in the parameters estimated by solving the inverse problem, where the uncertainty is expressed by the trace of the posterior covariance. Computing optimal experimental designs (OEDs) is particularly challenging for inverse problems governed by computationally expensive PDE models with infinite-dimensional (or, after discretization, high-dimensional) parameters. To alleviate the computational cost, we exploit the problem structure and build a low-rank approximation of the parameter-to-observable map, preconditioned with the square root of the prior covariance operator. The availability of this low-rank surrogate, relieves our method from expensive PDE solves when evaluating the optimal experimental design objective function, i.e., the trace of the posterior covariance, and its derivatives. Moreover, we employ a randomized trace estimator for efficient evaluation of the OED objective function. We control the sparsity of the sensor configuration by employing a sequence of penalty functions that successively approximate the l0-"norm"; this results in binary designs that characterize optimal sensor locations. We present numerical results for inference of the initial condition from spatiotemporal observations in a time-dependent advection-diffusion problem in two and three space dimensions. We find that an optimal design can be computed at a cost, measured in number of forward PDE solves, that is independent of the parameter and sensor dimensions. Moreover, the numerical optimization problem for finding the optimal design can be solved in a number of interior-point quasi-Newton iterations that is insensitive to the parameter and sensor dimensions. We demonstrate numerically that l0-sparsified experimental designs obtained via a continuation method outperform l1-sparsified designs.

AB - We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the location of sensors (at which observational data are collected) to minimize the uncertainty in the parameters estimated by solving the inverse problem, where the uncertainty is expressed by the trace of the posterior covariance. Computing optimal experimental designs (OEDs) is particularly challenging for inverse problems governed by computationally expensive PDE models with infinite-dimensional (or, after discretization, high-dimensional) parameters. To alleviate the computational cost, we exploit the problem structure and build a low-rank approximation of the parameter-to-observable map, preconditioned with the square root of the prior covariance operator. The availability of this low-rank surrogate, relieves our method from expensive PDE solves when evaluating the optimal experimental design objective function, i.e., the trace of the posterior covariance, and its derivatives. Moreover, we employ a randomized trace estimator for efficient evaluation of the OED objective function. We control the sparsity of the sensor configuration by employing a sequence of penalty functions that successively approximate the l0-"norm"; this results in binary designs that characterize optimal sensor locations. We present numerical results for inference of the initial condition from spatiotemporal observations in a time-dependent advection-diffusion problem in two and three space dimensions. We find that an optimal design can be computed at a cost, measured in number of forward PDE solves, that is independent of the parameter and sensor dimensions. Moreover, the numerical optimization problem for finding the optimal design can be solved in a number of interior-point quasi-Newton iterations that is insensitive to the parameter and sensor dimensions. We demonstrate numerically that l0-sparsified experimental designs obtained via a continuation method outperform l1-sparsified designs.

KW - A-optimal design

KW - Bayesian inference

KW - Ill-posed inverse problems

KW - Low-rank approximation

KW - Optimal experimental design

KW - Randomized SVD

KW - Randomized trace estimator

KW - Sensor placement

UR - http://www.scopus.com/inward/record.url?scp=84911378439&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911378439&partnerID=8YFLogxK

U2 - 10.1137/130933381

DO - 10.1137/130933381

M3 - Article

AN - SCOPUS:84911378439

VL - 36

SP - A2122-A2148

JO - SIAM Journal of Scientific Computing

JF - SIAM Journal of Scientific Computing

SN - 1064-8275

IS - 5

ER -