Local asymptotics for controlled martingales

Scott Armstrong, Ofer Zeitouni

Research output: Contribution to journalArticle

Abstract

We consider controlled martingales with bounded steps where the controller is allowed at each step to choose the distribution of the next step, and where the goal is to hit a fixed ball at the origin at time n. We show that the algebraic rate of decay (as n increases to infinity) of the value function in the discrete setup coincides with its continuous counterpart, provided a reachability assumption is satisfied. We also study in some detail the uniformly elliptic case and obtain explicit bounds on the rate of decay. This generalizes and improves upon several recent studies of the one dimensional case, and is a discrete analogue of a stochastic control problem recently investigated in Armstrong and Trokhimtchouck [Calc. Var. Partial Differential Equations 38 (2010) 521-540].

Original languageEnglish (US)
Pages (from-to)1467-1494
Number of pages28
JournalAnnals of Applied Probability
Volume26
Issue number3
DOIs
StatePublished - Jun 1 2016

Fingerprint

Martingale
Decay
Explicit Bounds
Stochastic Control
Reachability
Hits
Value Function
Control Problem
Ball
Partial differential equation
Choose
Infinity
Analogue
Controller
Generalise
Partial differential equations
Stochastic control
Value function

Keywords

  • Martingale
  • Nonlinear parabolic equation
  • Stochastic control

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Cite this

Local asymptotics for controlled martingales. / Armstrong, Scott; Zeitouni, Ofer.

In: Annals of Applied Probability, Vol. 26, No. 3, 01.06.2016, p. 1467-1494.

Research output: Contribution to journalArticle

Armstrong, Scott ; Zeitouni, Ofer. / Local asymptotics for controlled martingales. In: Annals of Applied Probability. 2016 ; Vol. 26, No. 3. pp. 1467-1494.
@article{6ae5a71da6754a28996f04ca74d116c3,
title = "Local asymptotics for controlled martingales",
abstract = "We consider controlled martingales with bounded steps where the controller is allowed at each step to choose the distribution of the next step, and where the goal is to hit a fixed ball at the origin at time n. We show that the algebraic rate of decay (as n increases to infinity) of the value function in the discrete setup coincides with its continuous counterpart, provided a reachability assumption is satisfied. We also study in some detail the uniformly elliptic case and obtain explicit bounds on the rate of decay. This generalizes and improves upon several recent studies of the one dimensional case, and is a discrete analogue of a stochastic control problem recently investigated in Armstrong and Trokhimtchouck [Calc. Var. Partial Differential Equations 38 (2010) 521-540].",
keywords = "Martingale, Nonlinear parabolic equation, Stochastic control",
author = "Scott Armstrong and Ofer Zeitouni",
year = "2016",
month = "6",
day = "1",
doi = "10.1214/15-AAP1123",
language = "English (US)",
volume = "26",
pages = "1467--1494",
journal = "Annals of Applied Probability",
issn = "1050-5164",
publisher = "Institute of Mathematical Statistics",
number = "3",

}

TY - JOUR

T1 - Local asymptotics for controlled martingales

AU - Armstrong, Scott

AU - Zeitouni, Ofer

PY - 2016/6/1

Y1 - 2016/6/1

N2 - We consider controlled martingales with bounded steps where the controller is allowed at each step to choose the distribution of the next step, and where the goal is to hit a fixed ball at the origin at time n. We show that the algebraic rate of decay (as n increases to infinity) of the value function in the discrete setup coincides with its continuous counterpart, provided a reachability assumption is satisfied. We also study in some detail the uniformly elliptic case and obtain explicit bounds on the rate of decay. This generalizes and improves upon several recent studies of the one dimensional case, and is a discrete analogue of a stochastic control problem recently investigated in Armstrong and Trokhimtchouck [Calc. Var. Partial Differential Equations 38 (2010) 521-540].

AB - We consider controlled martingales with bounded steps where the controller is allowed at each step to choose the distribution of the next step, and where the goal is to hit a fixed ball at the origin at time n. We show that the algebraic rate of decay (as n increases to infinity) of the value function in the discrete setup coincides with its continuous counterpart, provided a reachability assumption is satisfied. We also study in some detail the uniformly elliptic case and obtain explicit bounds on the rate of decay. This generalizes and improves upon several recent studies of the one dimensional case, and is a discrete analogue of a stochastic control problem recently investigated in Armstrong and Trokhimtchouck [Calc. Var. Partial Differential Equations 38 (2010) 521-540].

KW - Martingale

KW - Nonlinear parabolic equation

KW - Stochastic control

UR - http://www.scopus.com/inward/record.url?scp=84979072240&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84979072240&partnerID=8YFLogxK

U2 - 10.1214/15-AAP1123

DO - 10.1214/15-AAP1123

M3 - Article

VL - 26

SP - 1467

EP - 1494

JO - Annals of Applied Probability

JF - Annals of Applied Probability

SN - 1050-5164

IS - 3

ER -