Ensemble Kalman filters for dynamical systems with unresolved turbulence

Ian Grooms, Yoonsang Lee, Andrew J. Majda

Research output: Contribution to journalArticle

Abstract

Ensemble Kalman filters are developed for turbulent dynamical systems where the forecast model does not resolve all the active scales of motion. Coarse-resolution models are intended to predict the large-scale part of the true dynamics, but observations invariably include contributions from both the resolved large scales and the unresolved small scales. The error due to the contribution of unresolved scales to the observations, called 'representation' or 'representativeness' error, is often included as part of the observation error, in addition to the raw measurement error, when estimating the large-scale part of the system. It is here shown how stochastic superparameterization (a multiscale method for subgridscale parameterization) can be used to provide estimates of the statistics of the unresolved scales. In addition, a new framework is developed wherein small-scale statistics can be used to estimate both the resolved and unresolved components of the solution.The one-dimensional test problem from dispersive wave turbulence used here is computationally tractable yet is particularly difficult for filtering because of the non-Gaussian extreme event statistics and substantial small scale turbulence: a shallow energy spectrum proportional to k -5/6 (where k is the wavenumber) results in two-thirds of the climatological variance being carried by the unresolved small scales. Because the unresolved scales contain so much energy, filters that ignore the representation error fail utterly to provide meaningful estimates of the system state. Inclusion of a time-independent climatological estimate of the representation error in a standard framework leads to inaccurate estimates of the large-scale part of the signal; accurate estimates of the large scales are only achieved by using stochastic superparameterization to provide evolving, large-scale dependent predictions of the small-scale statistics. Again, because the unresolved scales contain so much energy, even an accurate estimate of the large-scale part of the system does not provide an accurate estimate of the true state. By providing simultaneous estimates of both the large- and small-scale parts of the solution, the new framework is able to provide accurate estimates of the true system state.

Original languageEnglish (US)
Pages (from-to)435-452
Number of pages18
JournalJournal of Computational Physics
Volume273
DOIs
StatePublished - Sep 15 2014

Fingerprint

Kalman filters
dynamical systems
Dynamical systems
Turbulence
turbulence
Statistics
estimates
Parameterization
Measurement errors
statistics
parameterization

Keywords

  • Ensemble Kalman filter
  • Representation error
  • Superparameterization
  • Turbulent dynamics

ASJC Scopus subject areas

  • Computer Science Applications
  • Physics and Astronomy (miscellaneous)

Cite this

Ensemble Kalman filters for dynamical systems with unresolved turbulence. / Grooms, Ian; Lee, Yoonsang; Majda, Andrew J.

In: Journal of Computational Physics, Vol. 273, 15.09.2014, p. 435-452.

Research output: Contribution to journalArticle

Grooms, Ian ; Lee, Yoonsang ; Majda, Andrew J. / Ensemble Kalman filters for dynamical systems with unresolved turbulence. In: Journal of Computational Physics. 2014 ; Vol. 273. pp. 435-452.
@article{d9535ebee933476f9fe7aa672f549733,
title = "Ensemble Kalman filters for dynamical systems with unresolved turbulence",
abstract = "Ensemble Kalman filters are developed for turbulent dynamical systems where the forecast model does not resolve all the active scales of motion. Coarse-resolution models are intended to predict the large-scale part of the true dynamics, but observations invariably include contributions from both the resolved large scales and the unresolved small scales. The error due to the contribution of unresolved scales to the observations, called 'representation' or 'representativeness' error, is often included as part of the observation error, in addition to the raw measurement error, when estimating the large-scale part of the system. It is here shown how stochastic superparameterization (a multiscale method for subgridscale parameterization) can be used to provide estimates of the statistics of the unresolved scales. In addition, a new framework is developed wherein small-scale statistics can be used to estimate both the resolved and unresolved components of the solution.The one-dimensional test problem from dispersive wave turbulence used here is computationally tractable yet is particularly difficult for filtering because of the non-Gaussian extreme event statistics and substantial small scale turbulence: a shallow energy spectrum proportional to k -5/6 (where k is the wavenumber) results in two-thirds of the climatological variance being carried by the unresolved small scales. Because the unresolved scales contain so much energy, filters that ignore the representation error fail utterly to provide meaningful estimates of the system state. Inclusion of a time-independent climatological estimate of the representation error in a standard framework leads to inaccurate estimates of the large-scale part of the signal; accurate estimates of the large scales are only achieved by using stochastic superparameterization to provide evolving, large-scale dependent predictions of the small-scale statistics. Again, because the unresolved scales contain so much energy, even an accurate estimate of the large-scale part of the system does not provide an accurate estimate of the true state. By providing simultaneous estimates of both the large- and small-scale parts of the solution, the new framework is able to provide accurate estimates of the true system state.",
keywords = "Ensemble Kalman filter, Representation error, Superparameterization, Turbulent dynamics",
author = "Ian Grooms and Yoonsang Lee and Majda, {Andrew J.}",
year = "2014",
month = "9",
day = "15",
doi = "10.1016/j.jcp.2014.05.037",
language = "English (US)",
volume = "273",
pages = "435--452",
journal = "Journal of Computational Physics",
issn = "0021-9991",
publisher = "Academic Press Inc.",

}

TY - JOUR

T1 - Ensemble Kalman filters for dynamical systems with unresolved turbulence

AU - Grooms, Ian

AU - Lee, Yoonsang

AU - Majda, Andrew J.

PY - 2014/9/15

Y1 - 2014/9/15

N2 - Ensemble Kalman filters are developed for turbulent dynamical systems where the forecast model does not resolve all the active scales of motion. Coarse-resolution models are intended to predict the large-scale part of the true dynamics, but observations invariably include contributions from both the resolved large scales and the unresolved small scales. The error due to the contribution of unresolved scales to the observations, called 'representation' or 'representativeness' error, is often included as part of the observation error, in addition to the raw measurement error, when estimating the large-scale part of the system. It is here shown how stochastic superparameterization (a multiscale method for subgridscale parameterization) can be used to provide estimates of the statistics of the unresolved scales. In addition, a new framework is developed wherein small-scale statistics can be used to estimate both the resolved and unresolved components of the solution.The one-dimensional test problem from dispersive wave turbulence used here is computationally tractable yet is particularly difficult for filtering because of the non-Gaussian extreme event statistics and substantial small scale turbulence: a shallow energy spectrum proportional to k -5/6 (where k is the wavenumber) results in two-thirds of the climatological variance being carried by the unresolved small scales. Because the unresolved scales contain so much energy, filters that ignore the representation error fail utterly to provide meaningful estimates of the system state. Inclusion of a time-independent climatological estimate of the representation error in a standard framework leads to inaccurate estimates of the large-scale part of the signal; accurate estimates of the large scales are only achieved by using stochastic superparameterization to provide evolving, large-scale dependent predictions of the small-scale statistics. Again, because the unresolved scales contain so much energy, even an accurate estimate of the large-scale part of the system does not provide an accurate estimate of the true state. By providing simultaneous estimates of both the large- and small-scale parts of the solution, the new framework is able to provide accurate estimates of the true system state.

AB - Ensemble Kalman filters are developed for turbulent dynamical systems where the forecast model does not resolve all the active scales of motion. Coarse-resolution models are intended to predict the large-scale part of the true dynamics, but observations invariably include contributions from both the resolved large scales and the unresolved small scales. The error due to the contribution of unresolved scales to the observations, called 'representation' or 'representativeness' error, is often included as part of the observation error, in addition to the raw measurement error, when estimating the large-scale part of the system. It is here shown how stochastic superparameterization (a multiscale method for subgridscale parameterization) can be used to provide estimates of the statistics of the unresolved scales. In addition, a new framework is developed wherein small-scale statistics can be used to estimate both the resolved and unresolved components of the solution.The one-dimensional test problem from dispersive wave turbulence used here is computationally tractable yet is particularly difficult for filtering because of the non-Gaussian extreme event statistics and substantial small scale turbulence: a shallow energy spectrum proportional to k -5/6 (where k is the wavenumber) results in two-thirds of the climatological variance being carried by the unresolved small scales. Because the unresolved scales contain so much energy, filters that ignore the representation error fail utterly to provide meaningful estimates of the system state. Inclusion of a time-independent climatological estimate of the representation error in a standard framework leads to inaccurate estimates of the large-scale part of the signal; accurate estimates of the large scales are only achieved by using stochastic superparameterization to provide evolving, large-scale dependent predictions of the small-scale statistics. Again, because the unresolved scales contain so much energy, even an accurate estimate of the large-scale part of the system does not provide an accurate estimate of the true state. By providing simultaneous estimates of both the large- and small-scale parts of the solution, the new framework is able to provide accurate estimates of the true system state.

KW - Ensemble Kalman filter

KW - Representation error

KW - Superparameterization

KW - Turbulent dynamics

UR - http://www.scopus.com/inward/record.url?scp=84901659880&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901659880&partnerID=8YFLogxK

U2 - 10.1016/j.jcp.2014.05.037

DO - 10.1016/j.jcp.2014.05.037

M3 - Article

VL - 273

SP - 435

EP - 452

JO - Journal of Computational Physics

JF - Journal of Computational Physics

SN - 0021-9991

ER -