An empirical comparison of two safe regression test selection techniques

P. G. Frankl, G. Rothermel, K. Sayre, F. I. Vokolos

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Regression test selection techniques reduce the cost of regression testing by selecting a subset of an existing test suite to use in retesting a modified program. Safe regression test selection techniques guarantee (under specific conditions) that the selected subset will not omit faults that could have been revealed by the entire suite. Many regression test selection techniques have been described in the literature. Empirical studies of some of these techniques have shown that they can be beneficial, but only a few studies have empirically compared different techniques, and fewer still have considered safe techniques. In this paper, we report the results of a comparative empirical study of implementations of two safe regression test selection techniques: DejaVu and Pytia. Our results show that, despite differences in their approaches, and despite the theoretically greater ability of DejaVu to select smaller test suites than Pythia, the two techniques often selected equivalent test suites in practice, at comparable costs. These results suggest that factors such as ease of implementation, generality, and availability of supporting tools and data may play a greater role than cost-effectiveness for practitioners choosing between these techniques.

    Original languageEnglish (US)
    Title of host publicationProceedings - 2003 International Symposium on Empirical Software Engineering, ISESE 2003
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages195-204
    Number of pages10
    ISBN (Electronic)0769520022, 9780769520025
    DOIs
    StatePublished - Jan 1 2003
    Event2003 International Symposium on Empirical Software Engineering, ISESE 2003 - Rome, Italy
    Duration: Sep 30 2003Oct 1 2003

    Publication series

    NameProceedings - 2003 International Symposium on Empirical Software Engineering, ISESE 2003

    Other

    Other2003 International Symposium on Empirical Software Engineering, ISESE 2003
    CountryItaly
    CityRome
    Period9/30/0310/1/03

    Keywords

    • Computer science
    • Costs
    • Fault detection
    • Information science
    • Performance evaluation
    • Safety
    • Software engineering
    • Software testing
    • Software tools

    ASJC Scopus subject areas

    • Software

    Fingerprint Dive into the research topics of 'An empirical comparison of two safe regression test selection techniques'. Together they form a unique fingerprint.

  • Cite this

    Frankl, P. G., Rothermel, G., Sayre, K., & Vokolos, F. I. (2003). An empirical comparison of two safe regression test selection techniques. In Proceedings - 2003 International Symposium on Empirical Software Engineering, ISESE 2003 (pp. 195-204). [1237978] (Proceedings - 2003 International Symposium on Empirical Software Engineering, ISESE 2003). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISESE.2003.1237978