Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics

Research output: Contribution to journalArticle


This paper presents a novel policy iteration approach for finding online adaptive optimal controllers for continuous-time linear systems with completely unknown system dynamics. The proposed approach employs the approximate/adaptive dynamic programming technique to iteratively solve the algebraic Riccati equation using the online information of state and input, without requiring the a priori knowledge of the system matrices. In addition, all iterations can be conducted by using repeatedly the same state and input information on some fixed time intervals. A practical online algorithm is developed in this paper, and is applied to the controller design for a turbocharged diesel engine with exhaust gas recirculation. Finally, several aspects of future work are discussed.

Original languageEnglish (US)
Pages (from-to)2699-2704
Number of pages6
Issue number10
StatePublished - Oct 1 2012



  • Adaptive optimal control
  • Linear-quadratic regulator (LQR)
  • Policy iterations

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this