Empirical studies on test effectiveness for database applications

Chixiang Zhou, Phyllis Frankl

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    This paper presents empirical studies of test effectiveness for Java database applications. We primarily address two research questions: (1) What is the relationship between test set size, coverage criteria, and test effectiveness for Java/JDBC programs? (2) Which adequacy criterion is more suitable for testing Java database applications, statement coverage, branch coverage, or command form coverage? We collected data sets by experimenting on several moderately complex open source database application programs, and performed a series of rigorous and comprehensive statistical analyses. The results show that linear models fit the relationship of size and coverage to effectiveness well and that coverage appears to have greater impact on effectiveness than size. However, surprisingly, command form coverage was not consistently more effective than statement or branch coverage.

    Original languageEnglish (US)
    Title of host publicationProceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012
    Pages61-70
    Number of pages10
    DOIs
    StatePublished - 2012
    Event5th IEEE International Conference on Software Testing, Verification and Validation, ICST 2012 - Montreal, QC, Canada
    Duration: Apr 17 2012Apr 21 2012

    Other

    Other5th IEEE International Conference on Software Testing, Verification and Validation, ICST 2012
    CountryCanada
    CityMontreal, QC
    Period4/17/124/21/12

    Fingerprint

    Application programs
    Testing

    Keywords

    • Experimentation
    • Java Database Applications
    • Statistical Analysis
    • Test Adequacy Criteria

    ASJC Scopus subject areas

    • Software

    Cite this

    Zhou, C., & Frankl, P. (2012). Empirical studies on test effectiveness for database applications. In Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012 (pp. 61-70). [6200097] https://doi.org/10.1109/ICST.2012.86

    Empirical studies on test effectiveness for database applications. / Zhou, Chixiang; Frankl, Phyllis.

    Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012. 2012. p. 61-70 6200097.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Zhou, C & Frankl, P 2012, Empirical studies on test effectiveness for database applications. in Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012., 6200097, pp. 61-70, 5th IEEE International Conference on Software Testing, Verification and Validation, ICST 2012, Montreal, QC, Canada, 4/17/12. https://doi.org/10.1109/ICST.2012.86
    Zhou C, Frankl P. Empirical studies on test effectiveness for database applications. In Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012. 2012. p. 61-70. 6200097 https://doi.org/10.1109/ICST.2012.86
    Zhou, Chixiang ; Frankl, Phyllis. / Empirical studies on test effectiveness for database applications. Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012. 2012. pp. 61-70
    @inproceedings{e5068385e7884845b9f5f1e73c194839,
    title = "Empirical studies on test effectiveness for database applications",
    abstract = "This paper presents empirical studies of test effectiveness for Java database applications. We primarily address two research questions: (1) What is the relationship between test set size, coverage criteria, and test effectiveness for Java/JDBC programs? (2) Which adequacy criterion is more suitable for testing Java database applications, statement coverage, branch coverage, or command form coverage? We collected data sets by experimenting on several moderately complex open source database application programs, and performed a series of rigorous and comprehensive statistical analyses. The results show that linear models fit the relationship of size and coverage to effectiveness well and that coverage appears to have greater impact on effectiveness than size. However, surprisingly, command form coverage was not consistently more effective than statement or branch coverage.",
    keywords = "Experimentation, Java Database Applications, Statistical Analysis, Test Adequacy Criteria",
    author = "Chixiang Zhou and Phyllis Frankl",
    year = "2012",
    doi = "10.1109/ICST.2012.86",
    language = "English (US)",
    isbn = "9780769546704",
    pages = "61--70",
    booktitle = "Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012",

    }

    TY - GEN

    T1 - Empirical studies on test effectiveness for database applications

    AU - Zhou, Chixiang

    AU - Frankl, Phyllis

    PY - 2012

    Y1 - 2012

    N2 - This paper presents empirical studies of test effectiveness for Java database applications. We primarily address two research questions: (1) What is the relationship between test set size, coverage criteria, and test effectiveness for Java/JDBC programs? (2) Which adequacy criterion is more suitable for testing Java database applications, statement coverage, branch coverage, or command form coverage? We collected data sets by experimenting on several moderately complex open source database application programs, and performed a series of rigorous and comprehensive statistical analyses. The results show that linear models fit the relationship of size and coverage to effectiveness well and that coverage appears to have greater impact on effectiveness than size. However, surprisingly, command form coverage was not consistently more effective than statement or branch coverage.

    AB - This paper presents empirical studies of test effectiveness for Java database applications. We primarily address two research questions: (1) What is the relationship between test set size, coverage criteria, and test effectiveness for Java/JDBC programs? (2) Which adequacy criterion is more suitable for testing Java database applications, statement coverage, branch coverage, or command form coverage? We collected data sets by experimenting on several moderately complex open source database application programs, and performed a series of rigorous and comprehensive statistical analyses. The results show that linear models fit the relationship of size and coverage to effectiveness well and that coverage appears to have greater impact on effectiveness than size. However, surprisingly, command form coverage was not consistently more effective than statement or branch coverage.

    KW - Experimentation

    KW - Java Database Applications

    KW - Statistical Analysis

    KW - Test Adequacy Criteria

    UR - http://www.scopus.com/inward/record.url?scp=84862338429&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84862338429&partnerID=8YFLogxK

    U2 - 10.1109/ICST.2012.86

    DO - 10.1109/ICST.2012.86

    M3 - Conference contribution

    AN - SCOPUS:84862338429

    SN - 9780769546704

    SP - 61

    EP - 70

    BT - Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012

    ER -