A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures

Linan Huang, Juntao Chen, Quanyan Zhu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.

Original languageEnglish (US)
Title of host publication2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509064397
DOIs
StatePublished - Oct 10 2017
Event2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Pittsburgh, United States
Duration: Apr 21 2017 → …

Other

Other2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017
CountryUnited States
CityPittsburgh
Period4/21/17 → …

Fingerprint

Critical infrastructures
Critical Infrastructure
Mechanism Design
Markov Decision Process
Linear programming
Large scale systems
Infrastructure
Resilience
Cascading Failure
Resiliency
Large-scale Systems
Approximation Scheme
Control Strategy
Demonstrate
Optimal design

ASJC Scopus subject areas

  • Artificial Intelligence
  • Energy Engineering and Power Technology
  • Computer Networks and Communications
  • Modeling and Simulation

Cite this

Huang, L., Chen, J., & Zhu, Q. (2017). A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. In 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings [8064531] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/MSCPES.2017.8064531

A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. / Huang, Linan; Chen, Juntao; Zhu, Quanyan.

2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. 8064531.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Huang, L, Chen, J & Zhu, Q 2017, A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. in 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings., 8064531, Institute of Electrical and Electronics Engineers Inc., 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017, Pittsburgh, United States, 4/21/17. https://doi.org/10.1109/MSCPES.2017.8064531
Huang L, Chen J, Zhu Q. A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. In 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings. Institute of Electrical and Electronics Engineers Inc. 2017. 8064531 https://doi.org/10.1109/MSCPES.2017.8064531
Huang, Linan ; Chen, Juntao ; Zhu, Quanyan. / A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures. 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017.
@inproceedings{510155fa3e984aafa7ed95022cea1fcf,
title = "A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures",
abstract = "Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.",
author = "Linan Huang and Juntao Chen and Quanyan Zhu",
year = "2017",
month = "10",
day = "10",
doi = "10.1109/MSCPES.2017.8064531",
language = "English (US)",
booktitle = "2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - A factored MDP approach to optimal mechanism design for resihent large-scale interdependent critical infrastructures

AU - Huang, Linan

AU - Chen, Juntao

AU - Zhu, Quanyan

PY - 2017/10/10

Y1 - 2017/10/10

N2 - Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.

AB - Enhancing the security and resilience of interdependent infrastructures is crucial. In this paper, we establish a theoretical framework based on Markov decision processes (MDPs) to design optimal resiliency mechanisms for interdependent infrastructures. We use MDPs to capture the dynamics of the failure of constituent components of an infrastructure and their cyber-physical dependencies. Factored MDPs and approximate linear programming are adopted for an exponentially growing dimension of both state and action spaces. Under our approximation scheme, the optimally distributed policy is equivalent to the centralized one. Finally, case studies in a large-scale interdependent system demonstrate the effectiveness of the control strategy to enhance the network resilience to cascading failures.

UR - http://www.scopus.com/inward/record.url?scp=85032879499&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032879499&partnerID=8YFLogxK

U2 - 10.1109/MSCPES.2017.8064531

DO - 10.1109/MSCPES.2017.8064531

M3 - Conference contribution

AN - SCOPUS:85032879499

BT - 2017 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems, MSCPES 2017 - Held as part of CPS Week, Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -