Data-driven robust optimal control design for uncertain cascaded systems using value iteration

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, a new non-model-based control design is proposed to solve the H∞ control problem for linear continuous-time systems. Our first contribution is to develop a robust control design by combining the zero-sum differential game theory with the gain assignment technique together. Compared with traditional game theory-based approaches, the obtained result allows us to assign arbitrarily the input-to-output L2 gain for a class of continuous-time linear cascaded systems. Moreover, the presence of dynamic uncertainty is tackled using the small-gain theory. Our second contribution is to give a new non-model-based robust adaptive dynamic programming (RADP) algorithm. In sharp contrast to the existing methods, the obtained algorithm is based on continuous-time value iteration (VI), and an initial stabilizing control policy is no longer required. Finally, an example of a power system is adopted to illustrate the effectiveness of the obtained algorithm.

Original languageEnglish (US)
Title of host publication2015 54th IEEE Conference on Decision and Control, CDC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages7610-7615
Number of pages6
Volume2016-February
ISBN (Print)9781479978861
DOIs
StatePublished - Feb 8 2016
Event54th IEEE Conference on Decision and Control, CDC 2015 - Osaka, Japan
Duration: Dec 15 2015Dec 18 2015

Other

Other54th IEEE Conference on Decision and Control, CDC 2015
CountryJapan
CityOsaka
Period12/15/1512/18/15

Fingerprint

Value Iteration
Uncertain systems
Uncertain Systems
Robust Control
Data-driven
Control Design
Optimal Control
Continuous-time Systems
Game theory
Game Theory
Linear Systems
Continuous time systems
Adaptive Dynamics
Zero sum game
Robust Design
Differential Games
Control Policy
Robust control
Dynamic programming
Power System

Keywords

  • Gain
  • Game theory
  • Games
  • Optimal control
  • Power system dynamics
  • Robustness
  • Symmetric matrices

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Cite this

Bian, T., & Jiang, Z-P. (2016). Data-driven robust optimal control design for uncertain cascaded systems using value iteration. In 2015 54th IEEE Conference on Decision and Control, CDC 2015 (Vol. 2016-February, pp. 7610-7615). [7403422] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CDC.2015.7403422

Data-driven robust optimal control design for uncertain cascaded systems using value iteration. / Bian, Tao; Jiang, Zhong-Ping.

2015 54th IEEE Conference on Decision and Control, CDC 2015. Vol. 2016-February Institute of Electrical and Electronics Engineers Inc., 2016. p. 7610-7615 7403422.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bian, T & Jiang, Z-P 2016, Data-driven robust optimal control design for uncertain cascaded systems using value iteration. in 2015 54th IEEE Conference on Decision and Control, CDC 2015. vol. 2016-February, 7403422, Institute of Electrical and Electronics Engineers Inc., pp. 7610-7615, 54th IEEE Conference on Decision and Control, CDC 2015, Osaka, Japan, 12/15/15. https://doi.org/10.1109/CDC.2015.7403422
Bian T, Jiang Z-P. Data-driven robust optimal control design for uncertain cascaded systems using value iteration. In 2015 54th IEEE Conference on Decision and Control, CDC 2015. Vol. 2016-February. Institute of Electrical and Electronics Engineers Inc. 2016. p. 7610-7615. 7403422 https://doi.org/10.1109/CDC.2015.7403422
Bian, Tao ; Jiang, Zhong-Ping. / Data-driven robust optimal control design for uncertain cascaded systems using value iteration. 2015 54th IEEE Conference on Decision and Control, CDC 2015. Vol. 2016-February Institute of Electrical and Electronics Engineers Inc., 2016. pp. 7610-7615
@inproceedings{823c2fe6da244cf8bc35721d6233b3de,
title = "Data-driven robust optimal control design for uncertain cascaded systems using value iteration",
abstract = "In this paper, a new non-model-based control design is proposed to solve the H∞ control problem for linear continuous-time systems. Our first contribution is to develop a robust control design by combining the zero-sum differential game theory with the gain assignment technique together. Compared with traditional game theory-based approaches, the obtained result allows us to assign arbitrarily the input-to-output L2 gain for a class of continuous-time linear cascaded systems. Moreover, the presence of dynamic uncertainty is tackled using the small-gain theory. Our second contribution is to give a new non-model-based robust adaptive dynamic programming (RADP) algorithm. In sharp contrast to the existing methods, the obtained algorithm is based on continuous-time value iteration (VI), and an initial stabilizing control policy is no longer required. Finally, an example of a power system is adopted to illustrate the effectiveness of the obtained algorithm.",
keywords = "Gain, Game theory, Games, Optimal control, Power system dynamics, Robustness, Symmetric matrices",
author = "Tao Bian and Zhong-Ping Jiang",
year = "2016",
month = "2",
day = "8",
doi = "10.1109/CDC.2015.7403422",
language = "English (US)",
isbn = "9781479978861",
volume = "2016-February",
pages = "7610--7615",
booktitle = "2015 54th IEEE Conference on Decision and Control, CDC 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Data-driven robust optimal control design for uncertain cascaded systems using value iteration

AU - Bian, Tao

AU - Jiang, Zhong-Ping

PY - 2016/2/8

Y1 - 2016/2/8

N2 - In this paper, a new non-model-based control design is proposed to solve the H∞ control problem for linear continuous-time systems. Our first contribution is to develop a robust control design by combining the zero-sum differential game theory with the gain assignment technique together. Compared with traditional game theory-based approaches, the obtained result allows us to assign arbitrarily the input-to-output L2 gain for a class of continuous-time linear cascaded systems. Moreover, the presence of dynamic uncertainty is tackled using the small-gain theory. Our second contribution is to give a new non-model-based robust adaptive dynamic programming (RADP) algorithm. In sharp contrast to the existing methods, the obtained algorithm is based on continuous-time value iteration (VI), and an initial stabilizing control policy is no longer required. Finally, an example of a power system is adopted to illustrate the effectiveness of the obtained algorithm.

AB - In this paper, a new non-model-based control design is proposed to solve the H∞ control problem for linear continuous-time systems. Our first contribution is to develop a robust control design by combining the zero-sum differential game theory with the gain assignment technique together. Compared with traditional game theory-based approaches, the obtained result allows us to assign arbitrarily the input-to-output L2 gain for a class of continuous-time linear cascaded systems. Moreover, the presence of dynamic uncertainty is tackled using the small-gain theory. Our second contribution is to give a new non-model-based robust adaptive dynamic programming (RADP) algorithm. In sharp contrast to the existing methods, the obtained algorithm is based on continuous-time value iteration (VI), and an initial stabilizing control policy is no longer required. Finally, an example of a power system is adopted to illustrate the effectiveness of the obtained algorithm.

KW - Gain

KW - Game theory

KW - Games

KW - Optimal control

KW - Power system dynamics

KW - Robustness

KW - Symmetric matrices

UR - http://www.scopus.com/inward/record.url?scp=84962019061&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962019061&partnerID=8YFLogxK

U2 - 10.1109/CDC.2015.7403422

DO - 10.1109/CDC.2015.7403422

M3 - Conference contribution

AN - SCOPUS:84962019061

SN - 9781479978861

VL - 2016-February

SP - 7610

EP - 7615

BT - 2015 54th IEEE Conference on Decision and Control, CDC 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -