Comparison of delivered reliability of branch, data flow and operational testing: A case study

Phyllis G. Frankl, Yuetang Deng

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Many analytical and empirical studies of software testing effectiveness have used the probability that a test set exposes at least one fault as the measure of effectiveness. That measure is useful for evaluating testing techniques when the goal of testing is to gain confidence that the program is free from faults. However, if the goal of testing is to improve the reliability of the program (by discovering and removing those faults that are most likely to cause failures when the software is in the field) then the measure of test effectiveness must distinguish between those faults that are likely to cause failures and those that are unlikely to do so. Delivered reliability was previously introduced as a means of comparing testing techniques in that setting. This paper empirically compares reliability delivered by three testing techniques, branch testing, the all-uses data flow testing criterion, and operational testing. The subject program is a moderate-sized C-program (about 10,000 LOC) produced by professional programmers and containing naturally occurring faults.

    Original languageEnglish (US)
    Title of host publicationProceedings of the ACM SIGSOFT 2000 International Symposium on Software Testing and Analysis
    EditorsM.J. Harrold, M.J. Harrold
    Pages124-134
    Number of pages11
    StatePublished - Dec 1 2000
    EventISSTA 00 Proceedings of the ACM SIGSOFT 2000 International Symposium on Software Testing and Analysis - Portland, OR, United States
    Duration: Aug 21 2000Aug 24 2000

    Publication series

    NameProceedings of the ACM SIGSOFT 2000 International Symposium on Software Testing and Analysis

    Other

    OtherISSTA 00 Proceedings of the ACM SIGSOFT 2000 International Symposium on Software Testing and Analysis
    CountryUnited States
    CityPortland, OR
    Period8/21/008/24/00

      Fingerprint

    Keywords

    • Software reliability
    • Software testing

    ASJC Scopus subject areas

    • Engineering(all)

    Cite this

    Frankl, P. G., & Deng, Y. (2000). Comparison of delivered reliability of branch, data flow and operational testing: A case study. In M. J. Harrold, & M. J. Harrold (Eds.), Proceedings of the ACM SIGSOFT 2000 International Symposium on Software Testing and Analysis (pp. 124-134). (Proceedings of the ACM SIGSOFT 2000 International Symposium on Software Testing and Analysis).