Robust adaptive dynamic programming for nonlinear control design

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a robust optimal controller design for unknown nonlinear systems from a perspective of robust adaptive dynamic programming (robust-ADP). The proposed methodology has several novel features. First, the class of nonlinear systems studied in the paper allows for the presence of dynamic uncertainties with unmeasured state and uncertain system order/dynamics. Second, in the absence of the dynamic uncertainty, the online policy iteration technique developed in this paper can be viewed as an extension of the existing ADP method to affine continuous-time nonlinear systems with completely unknown dynamics. Third, the theory of approximate/adaptive dynamic programming (ADP) is integrated for the first time with tools from modern nonlinear control theory, such as the nonlinear small-gain theorem, for robust optimal control design. It is shown that, with appropriate robust redesign, the robust-ADP controller asymptotically stabilizes the overall system. A practical robust-ADP-based online learning algorithm is developed in this paper, and is applied to the robust optimal controller design for a two-machine power system.

Original languageEnglish (US)
Title of host publicationProceedings of the IEEE Conference on Decision and Control
Pages1896-1901
Number of pages6
DOIs
StatePublished - 2012
Event51st IEEE Conference on Decision and Control, CDC 2012 - Maui, HI, United States
Duration: Dec 10 2012Dec 13 2012

Other

Other51st IEEE Conference on Decision and Control, CDC 2012
CountryUnited States
CityMaui, HI
Period12/10/1212/13/12

Fingerprint

Adaptive Dynamics
Nonlinear Control
Dynamic programming
Control Design
Dynamic Programming
Nonlinear systems
Nonlinear Systems
Controllers
Controller Design
Uncertain systems
Small Gain Theorem
Policy Iteration
Uncertainty
Unknown
Control theory
Online Learning
Continuous-time Systems
Learning algorithms
Online Algorithms
Uncertain Systems

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Cite this

Jiang, Y., & Jiang, Z-P. (2012). Robust adaptive dynamic programming for nonlinear control design. In Proceedings of the IEEE Conference on Decision and Control (pp. 1896-1901). [6426987] https://doi.org/10.1109/CDC.2012.6426987

Robust adaptive dynamic programming for nonlinear control design. / Jiang, Yu; Jiang, Zhong-Ping.

Proceedings of the IEEE Conference on Decision and Control. 2012. p. 1896-1901 6426987.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jiang, Y & Jiang, Z-P 2012, Robust adaptive dynamic programming for nonlinear control design. in Proceedings of the IEEE Conference on Decision and Control., 6426987, pp. 1896-1901, 51st IEEE Conference on Decision and Control, CDC 2012, Maui, HI, United States, 12/10/12. https://doi.org/10.1109/CDC.2012.6426987
Jiang Y, Jiang Z-P. Robust adaptive dynamic programming for nonlinear control design. In Proceedings of the IEEE Conference on Decision and Control. 2012. p. 1896-1901. 6426987 https://doi.org/10.1109/CDC.2012.6426987
Jiang, Yu ; Jiang, Zhong-Ping. / Robust adaptive dynamic programming for nonlinear control design. Proceedings of the IEEE Conference on Decision and Control. 2012. pp. 1896-1901
@inproceedings{a8842bd670034b82b8e6f6ce418c83cd,
title = "Robust adaptive dynamic programming for nonlinear control design",
abstract = "This paper presents a robust optimal controller design for unknown nonlinear systems from a perspective of robust adaptive dynamic programming (robust-ADP). The proposed methodology has several novel features. First, the class of nonlinear systems studied in the paper allows for the presence of dynamic uncertainties with unmeasured state and uncertain system order/dynamics. Second, in the absence of the dynamic uncertainty, the online policy iteration technique developed in this paper can be viewed as an extension of the existing ADP method to affine continuous-time nonlinear systems with completely unknown dynamics. Third, the theory of approximate/adaptive dynamic programming (ADP) is integrated for the first time with tools from modern nonlinear control theory, such as the nonlinear small-gain theorem, for robust optimal control design. It is shown that, with appropriate robust redesign, the robust-ADP controller asymptotically stabilizes the overall system. A practical robust-ADP-based online learning algorithm is developed in this paper, and is applied to the robust optimal controller design for a two-machine power system.",
author = "Yu Jiang and Zhong-Ping Jiang",
year = "2012",
doi = "10.1109/CDC.2012.6426987",
language = "English (US)",
pages = "1896--1901",
booktitle = "Proceedings of the IEEE Conference on Decision and Control",

}

TY - GEN

T1 - Robust adaptive dynamic programming for nonlinear control design

AU - Jiang, Yu

AU - Jiang, Zhong-Ping

PY - 2012

Y1 - 2012

N2 - This paper presents a robust optimal controller design for unknown nonlinear systems from a perspective of robust adaptive dynamic programming (robust-ADP). The proposed methodology has several novel features. First, the class of nonlinear systems studied in the paper allows for the presence of dynamic uncertainties with unmeasured state and uncertain system order/dynamics. Second, in the absence of the dynamic uncertainty, the online policy iteration technique developed in this paper can be viewed as an extension of the existing ADP method to affine continuous-time nonlinear systems with completely unknown dynamics. Third, the theory of approximate/adaptive dynamic programming (ADP) is integrated for the first time with tools from modern nonlinear control theory, such as the nonlinear small-gain theorem, for robust optimal control design. It is shown that, with appropriate robust redesign, the robust-ADP controller asymptotically stabilizes the overall system. A practical robust-ADP-based online learning algorithm is developed in this paper, and is applied to the robust optimal controller design for a two-machine power system.

AB - This paper presents a robust optimal controller design for unknown nonlinear systems from a perspective of robust adaptive dynamic programming (robust-ADP). The proposed methodology has several novel features. First, the class of nonlinear systems studied in the paper allows for the presence of dynamic uncertainties with unmeasured state and uncertain system order/dynamics. Second, in the absence of the dynamic uncertainty, the online policy iteration technique developed in this paper can be viewed as an extension of the existing ADP method to affine continuous-time nonlinear systems with completely unknown dynamics. Third, the theory of approximate/adaptive dynamic programming (ADP) is integrated for the first time with tools from modern nonlinear control theory, such as the nonlinear small-gain theorem, for robust optimal control design. It is shown that, with appropriate robust redesign, the robust-ADP controller asymptotically stabilizes the overall system. A practical robust-ADP-based online learning algorithm is developed in this paper, and is applied to the robust optimal controller design for a two-machine power system.

UR - http://www.scopus.com/inward/record.url?scp=84874285257&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84874285257&partnerID=8YFLogxK

U2 - 10.1109/CDC.2012.6426987

DO - 10.1109/CDC.2012.6426987

M3 - Conference contribution

AN - SCOPUS:84874285257

SP - 1896

EP - 1901

BT - Proceedings of the IEEE Conference on Decision and Control

ER -