An exploratory study of two efficient approaches for the sensitivity analysis of computationally expensive traffic simulation models

Qiao Ge, Biagio Ciuffo, Monica Menendez

    Research output: Contribution to journalArticle

    Abstract

    One of the main challenges arising when calibrating a complex traffic simulation model concerns the selection of the most important input parameters. The quasi-optimized trajectory-based elementary effects (quasi-OTEE) and the Kriging-based sensitivity analysis (SA) are two recently developed efficient approaches for the SA of computationally expensive simulation models. In this paper, two experimental studies using two different traffic simulation models (i.e., Aimsun and VISSIM) are presented to compare these two approaches and to better understand their advantages and disadvantages. Results show that both approaches are able to identify, to a good degree, the important parameters. In particular, the quasi-OTEE is better for screening the parameters, whereas the Kriging-based SA has higher precision in ranking the parameters. These findings suggest the following rule of thumb for the SA of computationally expensive traffic simulation models: the quasi-OTEE SA can be used first to screen the parameters and to decide which parameters to discard. Then, the Kriging-based SA can be used to refine the analysis and calculate first-order indexes to identify the correct rank of the important parameters.

    Original languageEnglish (US)
    Article number6805624
    Pages (from-to)1288-1297
    Number of pages10
    JournalIEEE Transactions on Intelligent Transportation Systems
    Volume15
    Issue number3
    DOIs
    StatePublished - Jan 1 2014

    Fingerprint

    Sensitivity analysis
    Trajectories
    Screening

    Keywords

    • Calibration
    • sensitivity analysis (SA)
    • traffic simulation model
    • uncertainty

    ASJC Scopus subject areas

    • Automotive Engineering
    • Mechanical Engineering
    • Computer Science Applications

    Cite this

    @article{39f22331aedf472486a324e479fdf187,
    title = "An exploratory study of two efficient approaches for the sensitivity analysis of computationally expensive traffic simulation models",
    abstract = "One of the main challenges arising when calibrating a complex traffic simulation model concerns the selection of the most important input parameters. The quasi-optimized trajectory-based elementary effects (quasi-OTEE) and the Kriging-based sensitivity analysis (SA) are two recently developed efficient approaches for the SA of computationally expensive simulation models. In this paper, two experimental studies using two different traffic simulation models (i.e., Aimsun and VISSIM) are presented to compare these two approaches and to better understand their advantages and disadvantages. Results show that both approaches are able to identify, to a good degree, the important parameters. In particular, the quasi-OTEE is better for screening the parameters, whereas the Kriging-based SA has higher precision in ranking the parameters. These findings suggest the following rule of thumb for the SA of computationally expensive traffic simulation models: the quasi-OTEE SA can be used first to screen the parameters and to decide which parameters to discard. Then, the Kriging-based SA can be used to refine the analysis and calculate first-order indexes to identify the correct rank of the important parameters.",
    keywords = "Calibration, sensitivity analysis (SA), traffic simulation model, uncertainty",
    author = "Qiao Ge and Biagio Ciuffo and Monica Menendez",
    year = "2014",
    month = "1",
    day = "1",
    doi = "10.1109/TITS.2014.2311161",
    language = "English (US)",
    volume = "15",
    pages = "1288--1297",
    journal = "IEEE Transactions on Intelligent Transportation Systems",
    issn = "1524-9050",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    number = "3",

    }

    TY - JOUR

    T1 - An exploratory study of two efficient approaches for the sensitivity analysis of computationally expensive traffic simulation models

    AU - Ge, Qiao

    AU - Ciuffo, Biagio

    AU - Menendez, Monica

    PY - 2014/1/1

    Y1 - 2014/1/1

    N2 - One of the main challenges arising when calibrating a complex traffic simulation model concerns the selection of the most important input parameters. The quasi-optimized trajectory-based elementary effects (quasi-OTEE) and the Kriging-based sensitivity analysis (SA) are two recently developed efficient approaches for the SA of computationally expensive simulation models. In this paper, two experimental studies using two different traffic simulation models (i.e., Aimsun and VISSIM) are presented to compare these two approaches and to better understand their advantages and disadvantages. Results show that both approaches are able to identify, to a good degree, the important parameters. In particular, the quasi-OTEE is better for screening the parameters, whereas the Kriging-based SA has higher precision in ranking the parameters. These findings suggest the following rule of thumb for the SA of computationally expensive traffic simulation models: the quasi-OTEE SA can be used first to screen the parameters and to decide which parameters to discard. Then, the Kriging-based SA can be used to refine the analysis and calculate first-order indexes to identify the correct rank of the important parameters.

    AB - One of the main challenges arising when calibrating a complex traffic simulation model concerns the selection of the most important input parameters. The quasi-optimized trajectory-based elementary effects (quasi-OTEE) and the Kriging-based sensitivity analysis (SA) are two recently developed efficient approaches for the SA of computationally expensive simulation models. In this paper, two experimental studies using two different traffic simulation models (i.e., Aimsun and VISSIM) are presented to compare these two approaches and to better understand their advantages and disadvantages. Results show that both approaches are able to identify, to a good degree, the important parameters. In particular, the quasi-OTEE is better for screening the parameters, whereas the Kriging-based SA has higher precision in ranking the parameters. These findings suggest the following rule of thumb for the SA of computationally expensive traffic simulation models: the quasi-OTEE SA can be used first to screen the parameters and to decide which parameters to discard. Then, the Kriging-based SA can be used to refine the analysis and calculate first-order indexes to identify the correct rank of the important parameters.

    KW - Calibration

    KW - sensitivity analysis (SA)

    KW - traffic simulation model

    KW - uncertainty

    UR - http://www.scopus.com/inward/record.url?scp=84902107060&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84902107060&partnerID=8YFLogxK

    U2 - 10.1109/TITS.2014.2311161

    DO - 10.1109/TITS.2014.2311161

    M3 - Article

    AN - SCOPUS:84902107060

    VL - 15

    SP - 1288

    EP - 1297

    JO - IEEE Transactions on Intelligent Transportation Systems

    JF - IEEE Transactions on Intelligent Transportation Systems

    SN - 1524-9050

    IS - 3

    M1 - 6805624

    ER -