Data assimilation in the low noise regime with application to the kuroshio

Eric Vanden Eijnden, Jonathan Weare

Research output: Contribution to journalArticle

Abstract

Online data assimilation techniques such as ensemble Kalman filters and particle filters lose accuracy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. Often they are signatures of the most interesting features of the underlying system and their prediction becomes the primary focus of the data assimilation procedure. The Kuroshio or Black Current that runs along the eastern coast of Japan is an example of such a system. It undergoes infrequent but dramatic changes of state between a small meander during which the current remains close to the coast of Japan, and a large meander during which it bulges away from the coast. Because of the important role that the Kuroshio plays in distributing heat and salinity in the surrounding region, prediction of these transitions is of acute interest. Here the authors focus on a regime in which both the stochastic forcing on the system and the observational noise are small. In this setting large deviation theory can be used to understand why standard filtering methods fail and guide the design of the more effective data assimilation techniques. Motivated by this analysis the authors propose several data assimilation strategies capable of efficiently handling rare events such as the transitions of the Kuroshio. These techniques are tested on a model of the Kuroshio and are shown to perform much better than standard filtering methods.

Original languageEnglish (US)
Pages (from-to)1822-1841
Number of pages20
JournalMonthly Weather Review
Volume141
Issue number6
DOIs
StatePublished - Jun 2013

Fingerprint

data assimilation
meander
coast
Kalman filter
prediction
filter
salinity
method

Keywords

  • Bayesian methods
  • Filtering techniques
  • Kalman filters
  • Numerical analysis/modeling
  • Numerical weather prediction/forecasting
  • Time series

ASJC Scopus subject areas

  • Atmospheric Science

Cite this

Data assimilation in the low noise regime with application to the kuroshio. / Vanden Eijnden, Eric; Weare, Jonathan.

In: Monthly Weather Review, Vol. 141, No. 6, 06.2013, p. 1822-1841.

Research output: Contribution to journalArticle

@article{d33de4d2a2bc4282905e77b7e6774c19,
title = "Data assimilation in the low noise regime with application to the kuroshio",
abstract = "Online data assimilation techniques such as ensemble Kalman filters and particle filters lose accuracy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. Often they are signatures of the most interesting features of the underlying system and their prediction becomes the primary focus of the data assimilation procedure. The Kuroshio or Black Current that runs along the eastern coast of Japan is an example of such a system. It undergoes infrequent but dramatic changes of state between a small meander during which the current remains close to the coast of Japan, and a large meander during which it bulges away from the coast. Because of the important role that the Kuroshio plays in distributing heat and salinity in the surrounding region, prediction of these transitions is of acute interest. Here the authors focus on a regime in which both the stochastic forcing on the system and the observational noise are small. In this setting large deviation theory can be used to understand why standard filtering methods fail and guide the design of the more effective data assimilation techniques. Motivated by this analysis the authors propose several data assimilation strategies capable of efficiently handling rare events such as the transitions of the Kuroshio. These techniques are tested on a model of the Kuroshio and are shown to perform much better than standard filtering methods.",
keywords = "Bayesian methods, Filtering techniques, Kalman filters, Numerical analysis/modeling, Numerical weather prediction/forecasting, Time series",
author = "{Vanden Eijnden}, Eric and Jonathan Weare",
year = "2013",
month = "6",
doi = "10.1175/MWR-D-12-00060.1",
language = "English (US)",
volume = "141",
pages = "1822--1841",
journal = "Monthly Weather Review",
issn = "0027-0644",
publisher = "American Meteorological Society",
number = "6",

}

TY - JOUR

T1 - Data assimilation in the low noise regime with application to the kuroshio

AU - Vanden Eijnden, Eric

AU - Weare, Jonathan

PY - 2013/6

Y1 - 2013/6

N2 - Online data assimilation techniques such as ensemble Kalman filters and particle filters lose accuracy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. Often they are signatures of the most interesting features of the underlying system and their prediction becomes the primary focus of the data assimilation procedure. The Kuroshio or Black Current that runs along the eastern coast of Japan is an example of such a system. It undergoes infrequent but dramatic changes of state between a small meander during which the current remains close to the coast of Japan, and a large meander during which it bulges away from the coast. Because of the important role that the Kuroshio plays in distributing heat and salinity in the surrounding region, prediction of these transitions is of acute interest. Here the authors focus on a regime in which both the stochastic forcing on the system and the observational noise are small. In this setting large deviation theory can be used to understand why standard filtering methods fail and guide the design of the more effective data assimilation techniques. Motivated by this analysis the authors propose several data assimilation strategies capable of efficiently handling rare events such as the transitions of the Kuroshio. These techniques are tested on a model of the Kuroshio and are shown to perform much better than standard filtering methods.

AB - Online data assimilation techniques such as ensemble Kalman filters and particle filters lose accuracy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. Often they are signatures of the most interesting features of the underlying system and their prediction becomes the primary focus of the data assimilation procedure. The Kuroshio or Black Current that runs along the eastern coast of Japan is an example of such a system. It undergoes infrequent but dramatic changes of state between a small meander during which the current remains close to the coast of Japan, and a large meander during which it bulges away from the coast. Because of the important role that the Kuroshio plays in distributing heat and salinity in the surrounding region, prediction of these transitions is of acute interest. Here the authors focus on a regime in which both the stochastic forcing on the system and the observational noise are small. In this setting large deviation theory can be used to understand why standard filtering methods fail and guide the design of the more effective data assimilation techniques. Motivated by this analysis the authors propose several data assimilation strategies capable of efficiently handling rare events such as the transitions of the Kuroshio. These techniques are tested on a model of the Kuroshio and are shown to perform much better than standard filtering methods.

KW - Bayesian methods

KW - Filtering techniques

KW - Kalman filters

KW - Numerical analysis/modeling

KW - Numerical weather prediction/forecasting

KW - Time series

UR - http://www.scopus.com/inward/record.url?scp=84880175097&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84880175097&partnerID=8YFLogxK

U2 - 10.1175/MWR-D-12-00060.1

DO - 10.1175/MWR-D-12-00060.1

M3 - Article

AN - SCOPUS:84880175097

VL - 141

SP - 1822

EP - 1841

JO - Monthly Weather Review

JF - Monthly Weather Review

SN - 0027-0644

IS - 6

ER -