Nonparametric bayesian estimation of freeway capacity distribution from censored observations

Eren Erman Ozguven, Kaan Ozbay

Research output: Contribution to journalArticle

Abstract

Previous studies have been made of the usefulness and effectiveness of survival analysis in transportation and traffic engineering studies with incomplete data in which the Kaplan-Meier estimate is proposed for determining traffic capacity distribution. However, well-known estimators like Kaplan-Meier and Nelson-Aalen have several disadvantages that make it difficult to obtain the traffic capacity distribution. First, neither estimator is defined for all values of traffic flows possible. That is, the maximum flow followed by a breakdown defines the final point of the estimated distribution curve. Therefore, parametric fitting tools have to be applied to obtain the remaining portion of the curve. Moreover, the discontinuity and nonsmoothness of the Kaplan-Meier and Nelson-Aalen estimates make it difficult to ensure the robustness of the estimation. In this paper the Kaplan-Meier and Nelson-Aalen nonparametric estimators are used to obtain the traffic capacity function of four freeway sections. Then a Bayesian nonparametric estimator, which is shown to be a Bayesian extension of the Kaplan-Meier estimator, is introduced for estimating the capacity distribution. This estimator assumes a Dirichlet process prior for the survival function under the minimization of a squared-error loss function. The results indicate that the curves obtained by using the Bayesian estimation method are smoother than those obtained with the other estimator. This smoothness also ensures the continuity in the vicinity of censored observations. Furthermore, the Bayesian estimates can be obtained for any traffic flow value regardless of the availability of data only for certain ranges of observations (including censored data).

Original languageEnglish (US)
Pages (from-to)20-29
Number of pages10
JournalTransportation Research Record
Issue number2061
DOIs
StatePublished - 2008

Fingerprint

Highway systems
Availability

ASJC Scopus subject areas

  • Civil and Structural Engineering
  • Mechanical Engineering

Cite this

Nonparametric bayesian estimation of freeway capacity distribution from censored observations. / Ozguven, Eren Erman; Ozbay, Kaan.

In: Transportation Research Record, No. 2061, 2008, p. 20-29.

Research output: Contribution to journalArticle

@article{d0d3a8b923bd4e1ea70adf3c51ab7400,
title = "Nonparametric bayesian estimation of freeway capacity distribution from censored observations",
abstract = "Previous studies have been made of the usefulness and effectiveness of survival analysis in transportation and traffic engineering studies with incomplete data in which the Kaplan-Meier estimate is proposed for determining traffic capacity distribution. However, well-known estimators like Kaplan-Meier and Nelson-Aalen have several disadvantages that make it difficult to obtain the traffic capacity distribution. First, neither estimator is defined for all values of traffic flows possible. That is, the maximum flow followed by a breakdown defines the final point of the estimated distribution curve. Therefore, parametric fitting tools have to be applied to obtain the remaining portion of the curve. Moreover, the discontinuity and nonsmoothness of the Kaplan-Meier and Nelson-Aalen estimates make it difficult to ensure the robustness of the estimation. In this paper the Kaplan-Meier and Nelson-Aalen nonparametric estimators are used to obtain the traffic capacity function of four freeway sections. Then a Bayesian nonparametric estimator, which is shown to be a Bayesian extension of the Kaplan-Meier estimator, is introduced for estimating the capacity distribution. This estimator assumes a Dirichlet process prior for the survival function under the minimization of a squared-error loss function. The results indicate that the curves obtained by using the Bayesian estimation method are smoother than those obtained with the other estimator. This smoothness also ensures the continuity in the vicinity of censored observations. Furthermore, the Bayesian estimates can be obtained for any traffic flow value regardless of the availability of data only for certain ranges of observations (including censored data).",
author = "Ozguven, {Eren Erman} and Kaan Ozbay",
year = "2008",
doi = "10.3141/2061-03",
language = "English (US)",
pages = "20--29",
journal = "Transportation Research Record",
issn = "0361-1981",
publisher = "US National Research Council",
number = "2061",

}

TY - JOUR

T1 - Nonparametric bayesian estimation of freeway capacity distribution from censored observations

AU - Ozguven, Eren Erman

AU - Ozbay, Kaan

PY - 2008

Y1 - 2008

N2 - Previous studies have been made of the usefulness and effectiveness of survival analysis in transportation and traffic engineering studies with incomplete data in which the Kaplan-Meier estimate is proposed for determining traffic capacity distribution. However, well-known estimators like Kaplan-Meier and Nelson-Aalen have several disadvantages that make it difficult to obtain the traffic capacity distribution. First, neither estimator is defined for all values of traffic flows possible. That is, the maximum flow followed by a breakdown defines the final point of the estimated distribution curve. Therefore, parametric fitting tools have to be applied to obtain the remaining portion of the curve. Moreover, the discontinuity and nonsmoothness of the Kaplan-Meier and Nelson-Aalen estimates make it difficult to ensure the robustness of the estimation. In this paper the Kaplan-Meier and Nelson-Aalen nonparametric estimators are used to obtain the traffic capacity function of four freeway sections. Then a Bayesian nonparametric estimator, which is shown to be a Bayesian extension of the Kaplan-Meier estimator, is introduced for estimating the capacity distribution. This estimator assumes a Dirichlet process prior for the survival function under the minimization of a squared-error loss function. The results indicate that the curves obtained by using the Bayesian estimation method are smoother than those obtained with the other estimator. This smoothness also ensures the continuity in the vicinity of censored observations. Furthermore, the Bayesian estimates can be obtained for any traffic flow value regardless of the availability of data only for certain ranges of observations (including censored data).

AB - Previous studies have been made of the usefulness and effectiveness of survival analysis in transportation and traffic engineering studies with incomplete data in which the Kaplan-Meier estimate is proposed for determining traffic capacity distribution. However, well-known estimators like Kaplan-Meier and Nelson-Aalen have several disadvantages that make it difficult to obtain the traffic capacity distribution. First, neither estimator is defined for all values of traffic flows possible. That is, the maximum flow followed by a breakdown defines the final point of the estimated distribution curve. Therefore, parametric fitting tools have to be applied to obtain the remaining portion of the curve. Moreover, the discontinuity and nonsmoothness of the Kaplan-Meier and Nelson-Aalen estimates make it difficult to ensure the robustness of the estimation. In this paper the Kaplan-Meier and Nelson-Aalen nonparametric estimators are used to obtain the traffic capacity function of four freeway sections. Then a Bayesian nonparametric estimator, which is shown to be a Bayesian extension of the Kaplan-Meier estimator, is introduced for estimating the capacity distribution. This estimator assumes a Dirichlet process prior for the survival function under the minimization of a squared-error loss function. The results indicate that the curves obtained by using the Bayesian estimation method are smoother than those obtained with the other estimator. This smoothness also ensures the continuity in the vicinity of censored observations. Furthermore, the Bayesian estimates can be obtained for any traffic flow value regardless of the availability of data only for certain ranges of observations (including censored data).

UR - http://www.scopus.com/inward/record.url?scp=56749171195&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=56749171195&partnerID=8YFLogxK

U2 - 10.3141/2061-03

DO - 10.3141/2061-03

M3 - Article

AN - SCOPUS:56749171195

SP - 20

EP - 29

JO - Transportation Research Record

JF - Transportation Research Record

SN - 0361-1981

IS - 2061

ER -