Global adaptive dynamic programming for continuous-time nonlinear polynomial systems

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a novel adaptive sub-optimal control method for continuous-time nonlinear polynomial systems from a perspective of adaptive dynamic programming (ADP). This is achieved by relaxing the problem of solving an Hamilton-Jacobi-Bellman (HJB) equation into an optimization problem, which is solved via a new policy iteration method. The proposed methodology distinguishes from previously known nonlinear ADP methods in that the neural network approximation is avoided and that the resultant control policy is globally stabilizing, instead of semiglobally or locally stabilizing. Furthermore, in the absence of the a prior knowledge of the system dynamics, an online learning method is devised to implement the proposed policy iteration technique by generalizing the current ADP theory. Finally, the proposed method is applied to a jet engine surge control problem.

Original languageEnglish (US)
Title of host publication19th IFAC World Congress IFAC 2014, Proceedings
PublisherIFAC Secretariat
Pages9756-9761
Number of pages6
Volume19
ISBN (Print)9783902823625
StatePublished - 2014
Event19th IFAC World Congress on International Federation of Automatic Control, IFAC 2014 - Cape Town, South Africa
Duration: Aug 24 2014Aug 29 2014

Other

Other19th IFAC World Congress on International Federation of Automatic Control, IFAC 2014
CountrySouth Africa
CityCape Town
Period8/24/148/29/14

Fingerprint

Dynamic programming
Polynomials
Programming theory
Jet engines
Dynamical systems
Neural networks

ASJC Scopus subject areas

  • Control and Systems Engineering

Cite this

Yu, J., & Jiang, Z-P. (2014). Global adaptive dynamic programming for continuous-time nonlinear polynomial systems. In 19th IFAC World Congress IFAC 2014, Proceedings (Vol. 19, pp. 9756-9761). IFAC Secretariat.

Global adaptive dynamic programming for continuous-time nonlinear polynomial systems. / Yu, Jiang; Jiang, Zhong-Ping.

19th IFAC World Congress IFAC 2014, Proceedings. Vol. 19 IFAC Secretariat, 2014. p. 9756-9761.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yu, J & Jiang, Z-P 2014, Global adaptive dynamic programming for continuous-time nonlinear polynomial systems. in 19th IFAC World Congress IFAC 2014, Proceedings. vol. 19, IFAC Secretariat, pp. 9756-9761, 19th IFAC World Congress on International Federation of Automatic Control, IFAC 2014, Cape Town, South Africa, 8/24/14.
Yu J, Jiang Z-P. Global adaptive dynamic programming for continuous-time nonlinear polynomial systems. In 19th IFAC World Congress IFAC 2014, Proceedings. Vol. 19. IFAC Secretariat. 2014. p. 9756-9761
Yu, Jiang ; Jiang, Zhong-Ping. / Global adaptive dynamic programming for continuous-time nonlinear polynomial systems. 19th IFAC World Congress IFAC 2014, Proceedings. Vol. 19 IFAC Secretariat, 2014. pp. 9756-9761
@inproceedings{062fc79a858348729a51c50a3bc4d78f,
title = "Global adaptive dynamic programming for continuous-time nonlinear polynomial systems",
abstract = "This paper presents a novel adaptive sub-optimal control method for continuous-time nonlinear polynomial systems from a perspective of adaptive dynamic programming (ADP). This is achieved by relaxing the problem of solving an Hamilton-Jacobi-Bellman (HJB) equation into an optimization problem, which is solved via a new policy iteration method. The proposed methodology distinguishes from previously known nonlinear ADP methods in that the neural network approximation is avoided and that the resultant control policy is globally stabilizing, instead of semiglobally or locally stabilizing. Furthermore, in the absence of the a prior knowledge of the system dynamics, an online learning method is devised to implement the proposed policy iteration technique by generalizing the current ADP theory. Finally, the proposed method is applied to a jet engine surge control problem.",
author = "Jiang Yu and Zhong-Ping Jiang",
year = "2014",
language = "English (US)",
isbn = "9783902823625",
volume = "19",
pages = "9756--9761",
booktitle = "19th IFAC World Congress IFAC 2014, Proceedings",
publisher = "IFAC Secretariat",

}

TY - GEN

T1 - Global adaptive dynamic programming for continuous-time nonlinear polynomial systems

AU - Yu, Jiang

AU - Jiang, Zhong-Ping

PY - 2014

Y1 - 2014

N2 - This paper presents a novel adaptive sub-optimal control method for continuous-time nonlinear polynomial systems from a perspective of adaptive dynamic programming (ADP). This is achieved by relaxing the problem of solving an Hamilton-Jacobi-Bellman (HJB) equation into an optimization problem, which is solved via a new policy iteration method. The proposed methodology distinguishes from previously known nonlinear ADP methods in that the neural network approximation is avoided and that the resultant control policy is globally stabilizing, instead of semiglobally or locally stabilizing. Furthermore, in the absence of the a prior knowledge of the system dynamics, an online learning method is devised to implement the proposed policy iteration technique by generalizing the current ADP theory. Finally, the proposed method is applied to a jet engine surge control problem.

AB - This paper presents a novel adaptive sub-optimal control method for continuous-time nonlinear polynomial systems from a perspective of adaptive dynamic programming (ADP). This is achieved by relaxing the problem of solving an Hamilton-Jacobi-Bellman (HJB) equation into an optimization problem, which is solved via a new policy iteration method. The proposed methodology distinguishes from previously known nonlinear ADP methods in that the neural network approximation is avoided and that the resultant control policy is globally stabilizing, instead of semiglobally or locally stabilizing. Furthermore, in the absence of the a prior knowledge of the system dynamics, an online learning method is devised to implement the proposed policy iteration technique by generalizing the current ADP theory. Finally, the proposed method is applied to a jet engine surge control problem.

UR - http://www.scopus.com/inward/record.url?scp=84929833855&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929833855&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84929833855

SN - 9783902823625

VL - 19

SP - 9756

EP - 9761

BT - 19th IFAC World Congress IFAC 2014, Proceedings

PB - IFAC Secretariat

ER -