A secure control learning framework for cyber-physical systems under sensor attacks

Yuanqiang Zhou, Kyriakos G. Vamvoudakis, Wassim M. Haddad, Zhong-Ping Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we develop a learning-based secure control framework for cyber-physical systems in the presence of sensor attacks. Specifically, we use several observer-based estimators to detect the attacks while also introducing a threat detection level function. We then solve the underlying joint state estimation and attack mitigation problems by using a reinforcement learning algorithm. Finally, an illustrative numerical example is provided to show the efficacy of the proposed framework.

Original languageEnglish (US)
Title of host publication2019 American Control Conference, ACC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4280-4285
Number of pages6
ISBN (Electronic)9781538679265
StatePublished - Jul 1 2019
Event2019 American Control Conference, ACC 2019 - Philadelphia, United States
Duration: Jul 10 2019Jul 12 2019

Publication series

NameProceedings of the American Control Conference
Volume2019-July
ISSN (Print)0743-1619

Conference

Conference2019 American Control Conference, ACC 2019
CountryUnited States
CityPhiladelphia
Period7/10/197/12/19

Fingerprint

Reinforcement learning
State estimation
Learning algorithms
Sensors
Cyber Physical System

Keywords

  • Attack estimation
  • Cyber-physical security
  • Differential games
  • Mitigation
  • Reinforcement learning

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Zhou, Y., Vamvoudakis, K. G., Haddad, W. M., & Jiang, Z-P. (2019). A secure control learning framework for cyber-physical systems under sensor attacks. In 2019 American Control Conference, ACC 2019 (pp. 4280-4285). [8814659] (Proceedings of the American Control Conference; Vol. 2019-July). Institute of Electrical and Electronics Engineers Inc..

A secure control learning framework for cyber-physical systems under sensor attacks. / Zhou, Yuanqiang; Vamvoudakis, Kyriakos G.; Haddad, Wassim M.; Jiang, Zhong-Ping.

2019 American Control Conference, ACC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 4280-4285 8814659 (Proceedings of the American Control Conference; Vol. 2019-July).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhou, Y, Vamvoudakis, KG, Haddad, WM & Jiang, Z-P 2019, A secure control learning framework for cyber-physical systems under sensor attacks. in 2019 American Control Conference, ACC 2019., 8814659, Proceedings of the American Control Conference, vol. 2019-July, Institute of Electrical and Electronics Engineers Inc., pp. 4280-4285, 2019 American Control Conference, ACC 2019, Philadelphia, United States, 7/10/19.
Zhou Y, Vamvoudakis KG, Haddad WM, Jiang Z-P. A secure control learning framework for cyber-physical systems under sensor attacks. In 2019 American Control Conference, ACC 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 4280-4285. 8814659. (Proceedings of the American Control Conference).
Zhou, Yuanqiang ; Vamvoudakis, Kyriakos G. ; Haddad, Wassim M. ; Jiang, Zhong-Ping. / A secure control learning framework for cyber-physical systems under sensor attacks. 2019 American Control Conference, ACC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 4280-4285 (Proceedings of the American Control Conference).
@inproceedings{0d7f84bc927047d19ee76051aa7cc483,
title = "A secure control learning framework for cyber-physical systems under sensor attacks",
abstract = "In this paper, we develop a learning-based secure control framework for cyber-physical systems in the presence of sensor attacks. Specifically, we use several observer-based estimators to detect the attacks while also introducing a threat detection level function. We then solve the underlying joint state estimation and attack mitigation problems by using a reinforcement learning algorithm. Finally, an illustrative numerical example is provided to show the efficacy of the proposed framework.",
keywords = "Attack estimation, Cyber-physical security, Differential games, Mitigation, Reinforcement learning",
author = "Yuanqiang Zhou and Vamvoudakis, {Kyriakos G.} and Haddad, {Wassim M.} and Zhong-Ping Jiang",
year = "2019",
month = "7",
day = "1",
language = "English (US)",
series = "Proceedings of the American Control Conference",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "4280--4285",
booktitle = "2019 American Control Conference, ACC 2019",

}

TY - GEN

T1 - A secure control learning framework for cyber-physical systems under sensor attacks

AU - Zhou, Yuanqiang

AU - Vamvoudakis, Kyriakos G.

AU - Haddad, Wassim M.

AU - Jiang, Zhong-Ping

PY - 2019/7/1

Y1 - 2019/7/1

N2 - In this paper, we develop a learning-based secure control framework for cyber-physical systems in the presence of sensor attacks. Specifically, we use several observer-based estimators to detect the attacks while also introducing a threat detection level function. We then solve the underlying joint state estimation and attack mitigation problems by using a reinforcement learning algorithm. Finally, an illustrative numerical example is provided to show the efficacy of the proposed framework.

AB - In this paper, we develop a learning-based secure control framework for cyber-physical systems in the presence of sensor attacks. Specifically, we use several observer-based estimators to detect the attacks while also introducing a threat detection level function. We then solve the underlying joint state estimation and attack mitigation problems by using a reinforcement learning algorithm. Finally, an illustrative numerical example is provided to show the efficacy of the proposed framework.

KW - Attack estimation

KW - Cyber-physical security

KW - Differential games

KW - Mitigation

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=85072288261&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072288261&partnerID=8YFLogxK

M3 - Conference contribution

T3 - Proceedings of the American Control Conference

SP - 4280

EP - 4285

BT - 2019 American Control Conference, ACC 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -