Adaptive and optimal output feedback control of linear systems: An adaptive dynamic programming approach

Weinan Gao, Yu Jiang, Zhong-Ping Jiang, Tianyou Chai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a computational adaptive optimal output feedback control method for continuous-time linear systems. By periodic sampling, we use measurable input/output data to reconstruct the unmeasurable state, and then utilize adaptive dynamic programming (ADP) technique to iteratively solve the discrete-time algebraic Riccati equation. An exploration noise is introduced for online learning purpose without compromising accuracy of the proposed iterative algorithm. The stability and the optimality of the sampled-data system in close-loop with the proposed control policy are also analyzed. The feasibility of the output feedback ADP scheme is validated by simulation on a third-order linear system.

Original languageEnglish (US)
Title of host publicationProceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2085-2090
Number of pages6
Volume2015-March
EditionMarch
DOIs
StatePublished - Mar 2 2015
Event2014 11th World Congress on Intelligent Control and Automation, WCICA 2014 - Shenyang, China
Duration: Jun 29 2014Jul 4 2014

Other

Other2014 11th World Congress on Intelligent Control and Automation, WCICA 2014
CountryChina
CityShenyang
Period6/29/147/4/14

Fingerprint

Dynamic programming
Feedback control
Linear systems
Riccati equations
Sampling
Feedback

Keywords

  • Approximate/adaptive dynamic programming(ADP)
  • Optimal control
  • Output feedback
  • Sampled-data systems

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Science Applications

Cite this

Gao, W., Jiang, Y., Jiang, Z-P., & Chai, T. (2015). Adaptive and optimal output feedback control of linear systems: An adaptive dynamic programming approach. In Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014 (March ed., Vol. 2015-March, pp. 2085-2090). [7053043] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WCICA.2014.7053043

Adaptive and optimal output feedback control of linear systems : An adaptive dynamic programming approach. / Gao, Weinan; Jiang, Yu; Jiang, Zhong-Ping; Chai, Tianyou.

Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014. Vol. 2015-March March. ed. Institute of Electrical and Electronics Engineers Inc., 2015. p. 2085-2090 7053043.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gao, W, Jiang, Y, Jiang, Z-P & Chai, T 2015, Adaptive and optimal output feedback control of linear systems: An adaptive dynamic programming approach. in Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014. March edn, vol. 2015-March, 7053043, Institute of Electrical and Electronics Engineers Inc., pp. 2085-2090, 2014 11th World Congress on Intelligent Control and Automation, WCICA 2014, Shenyang, China, 6/29/14. https://doi.org/10.1109/WCICA.2014.7053043
Gao W, Jiang Y, Jiang Z-P, Chai T. Adaptive and optimal output feedback control of linear systems: An adaptive dynamic programming approach. In Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014. March ed. Vol. 2015-March. Institute of Electrical and Electronics Engineers Inc. 2015. p. 2085-2090. 7053043 https://doi.org/10.1109/WCICA.2014.7053043
Gao, Weinan ; Jiang, Yu ; Jiang, Zhong-Ping ; Chai, Tianyou. / Adaptive and optimal output feedback control of linear systems : An adaptive dynamic programming approach. Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014. Vol. 2015-March March. ed. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 2085-2090
@inproceedings{781160071b8041388d1b0d4449375b00,
title = "Adaptive and optimal output feedback control of linear systems: An adaptive dynamic programming approach",
abstract = "This paper proposes a computational adaptive optimal output feedback control method for continuous-time linear systems. By periodic sampling, we use measurable input/output data to reconstruct the unmeasurable state, and then utilize adaptive dynamic programming (ADP) technique to iteratively solve the discrete-time algebraic Riccati equation. An exploration noise is introduced for online learning purpose without compromising accuracy of the proposed iterative algorithm. The stability and the optimality of the sampled-data system in close-loop with the proposed control policy are also analyzed. The feasibility of the output feedback ADP scheme is validated by simulation on a third-order linear system.",
keywords = "Approximate/adaptive dynamic programming(ADP), Optimal control, Output feedback, Sampled-data systems",
author = "Weinan Gao and Yu Jiang and Zhong-Ping Jiang and Tianyou Chai",
year = "2015",
month = "3",
day = "2",
doi = "10.1109/WCICA.2014.7053043",
language = "English (US)",
volume = "2015-March",
pages = "2085--2090",
booktitle = "Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
edition = "March",

}

TY - GEN

T1 - Adaptive and optimal output feedback control of linear systems

T2 - An adaptive dynamic programming approach

AU - Gao, Weinan

AU - Jiang, Yu

AU - Jiang, Zhong-Ping

AU - Chai, Tianyou

PY - 2015/3/2

Y1 - 2015/3/2

N2 - This paper proposes a computational adaptive optimal output feedback control method for continuous-time linear systems. By periodic sampling, we use measurable input/output data to reconstruct the unmeasurable state, and then utilize adaptive dynamic programming (ADP) technique to iteratively solve the discrete-time algebraic Riccati equation. An exploration noise is introduced for online learning purpose without compromising accuracy of the proposed iterative algorithm. The stability and the optimality of the sampled-data system in close-loop with the proposed control policy are also analyzed. The feasibility of the output feedback ADP scheme is validated by simulation on a third-order linear system.

AB - This paper proposes a computational adaptive optimal output feedback control method for continuous-time linear systems. By periodic sampling, we use measurable input/output data to reconstruct the unmeasurable state, and then utilize adaptive dynamic programming (ADP) technique to iteratively solve the discrete-time algebraic Riccati equation. An exploration noise is introduced for online learning purpose without compromising accuracy of the proposed iterative algorithm. The stability and the optimality of the sampled-data system in close-loop with the proposed control policy are also analyzed. The feasibility of the output feedback ADP scheme is validated by simulation on a third-order linear system.

KW - Approximate/adaptive dynamic programming(ADP)

KW - Optimal control

KW - Output feedback

KW - Sampled-data systems

UR - http://www.scopus.com/inward/record.url?scp=84932097857&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84932097857&partnerID=8YFLogxK

U2 - 10.1109/WCICA.2014.7053043

DO - 10.1109/WCICA.2014.7053043

M3 - Conference contribution

AN - SCOPUS:84932097857

VL - 2015-March

SP - 2085

EP - 2090

BT - Proceeding of the 11th World Congress on Intelligent Control and Automation, WCICA 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -