Data-based inference of generators for markov jump processes using convex optimization

Daan Crommelin, Eric Vanden-Eijnden

Research output: Contribution to journalArticle

Abstract

A variational approach to the estimation of generators for Markov jump processes from discretely sampled data is discussed and generalized. In this approach, one first calculates the spectrum of the discrete maximum likelihood estimator for the transition matrix consistent with the discrete data. Then the generator that best matches the spectrum is determined by solving a convex quadratic minimization problem with linear constraints (quadratic program). Here, we discuss the method in detail and position it in the context of maximum likelihood inference of generators from discretely sampled data. Furthermore, we show how the approach can be generalized to estimation from data sampled at nonconstant time intervals. Finally, we discuss numerical aspects of the algorithm for estimation of processes with high-dimensional state spaces. Numerical examples are presented throughout the paper.

Original languageEnglish (US)
Pages (from-to)1751-1778
Number of pages28
JournalMultiscale Modeling and Simulation
Volume7
Issue number4
DOIs
StatePublished - Dec 1 2009

    Fingerprint

Keywords

  • Estimation
  • Generator
  • Markov jump process
  • Quadratic program

ASJC Scopus subject areas

  • Chemistry(all)
  • Modeling and Simulation
  • Ecological Modeling
  • Physics and Astronomy(all)
  • Computer Science Applications

Cite this