Value iteration and adaptive optimal control for linear continuous-time systems

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.

Original languageEnglish (US)
Title of host publicationProceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages53-58
Number of pages6
ISBN (Print)9781467373364
DOIs
StatePublished - Sep 23 2015
Event7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015 - Siem Reap, Cambodia
Duration: Jul 15 2015Jul 17 2015

Other

Other7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015
CountryCambodia
CitySiem Reap
Period7/15/157/17/15

Fingerprint

Continuous time systems
Dynamic programming

ASJC Scopus subject areas

  • Artificial Intelligence
  • Control and Systems Engineering

Cite this

Bian, T., & Jiang, Z-P. (2015). Value iteration and adaptive optimal control for linear continuous-time systems. In Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015 (pp. 53-58). [7274547] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCIS.2015.7274547

Value iteration and adaptive optimal control for linear continuous-time systems. / Bian, Tao; Jiang, Zhong-Ping.

Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 53-58 7274547.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bian, T & Jiang, Z-P 2015, Value iteration and adaptive optimal control for linear continuous-time systems. in Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015., 7274547, Institute of Electrical and Electronics Engineers Inc., pp. 53-58, 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and the 7th IEEE International Conference on Robotics, Automation and Mechatronics, RAM 2015, Siem Reap, Cambodia, 7/15/15. https://doi.org/10.1109/ICCIS.2015.7274547
Bian T, Jiang Z-P. Value iteration and adaptive optimal control for linear continuous-time systems. In Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 53-58. 7274547 https://doi.org/10.1109/ICCIS.2015.7274547
Bian, Tao ; Jiang, Zhong-Ping. / Value iteration and adaptive optimal control for linear continuous-time systems. Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 53-58
@inproceedings{929746ce98fa465694c19432de86140d,
title = "Value iteration and adaptive optimal control for linear continuous-time systems",
abstract = "In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.",
author = "Tao Bian and Zhong-Ping Jiang",
year = "2015",
month = "9",
day = "23",
doi = "10.1109/ICCIS.2015.7274547",
language = "English (US)",
isbn = "9781467373364",
pages = "53--58",
booktitle = "Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Value iteration and adaptive optimal control for linear continuous-time systems

AU - Bian, Tao

AU - Jiang, Zhong-Ping

PY - 2015/9/23

Y1 - 2015/9/23

N2 - In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.

AB - In this paper, a new non-model-based optimal control design is proposed for linear continuous-time systems. First, a continuous-time value iteration (VI) algorithm is presented. Then, an adaptive dynamic programming (ADP) method based on the obtained VI algorithm is developed to solve the optimal control problem for linear continuous-time systems. Different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The convergence of the proposed method is investigated. A practical example is presented to illustrate the obtained results.

UR - http://www.scopus.com/inward/record.url?scp=84960889867&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84960889867&partnerID=8YFLogxK

U2 - 10.1109/ICCIS.2015.7274547

DO - 10.1109/ICCIS.2015.7274547

M3 - Conference contribution

SN - 9781467373364

SP - 53

EP - 58

BT - Proceedings of the 2015 7th IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2015 and Robotics, Automation and Mechatronics, RAM 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -