Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Search Based Software Engineering

SSBSE 2015: Search-Based Software Engineering pp 221–227Cite as

Regression Test Case Prioritisation for Guava

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 9275))

Abstract

We present a three objective formulation of regression test prioritisation. Our formulation involves the well-known, and widely-used objectives of Average Percentage of Statement Coverage (APSC) and Effective Execution Time (EET). However, we additionally include the Average Percentage of Change Coverage (APCC), which has not previously been used in search-based regression test optimisation. We apply our approach to prioritise the base and the collection package of the Guava project, which contains over 26,815 test cases. Our results demonstrate the value of search-based test case prioritisation: the sequences we find require only 0.2 % of the 26,815 test cases and only 0.45 % of their effective execution time. However, we find solutions that achieve more than 99.9 % of both regression testing objectives; covering both changed code and existing code. We also investigate the tension between these two objectives for Guava.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://code.google.com/p/guava-libraries/.

References

  1. Yoo, S., Harman, M.: Regression testing minimization, selection and prioritisation: a survey. Softw. Test. Verification Reliab. 22(2), 67–120 (2012)

    Article  Google Scholar 

  2. Rothermel, G., Untch, R.H., Chu, C., Harrold, M.J.: Prioritizing test cases for regression testing. IEEE Trans. Softw. Eng. 27(10), 929–948 (2001)

    Article  Google Scholar 

  3. Huang, P., Ma, X., Shen, D., Zhou, Y.: Performance regression testing target prioritisation via performance risk analysis. In: Proceedings of the 36th International Conference on Software Engineering, pp. 60–71. ACM, May 2014

    Google Scholar 

  4. Guava Project Web Site. https://github.com/google/guava

  5. http://blog.takipi.com/google-guava-5-things-you-never-knew-it-can-do/

  6. Jiang, B., Chan, W.K.: On the integration of test adequacy, test case prioritisation, and statistical fault localization. In: 2010 10th International Conference on Quality Software (QSIC), pp. 377–384. IEEE (2010)

    Google Scholar 

  7. Elbaum, S., Malishevsky, A.G., Rothermel, G.: Test case prioritisation: a family of empirical studies. IEEE Trans. Softw. Eng. 28(2), 159–182 (2002)

    Article  Google Scholar 

  8. Li, Z., Harman, M., Hierons, R.M.: Search algorithms for regression test case prioritisation. IEEE Trans. Softw. Eng. 33(4), 225–237 (2007)

    Article  Google Scholar 

  9. Yoo, S., Harman, M.: Pareto efficient multi-objective test case selection. In: Proceedings of the 2007 International Symposium on Software Testing and Analysis, pp. 140–150. ACM (2007)

    Google Scholar 

  10. Deb, K., Pratap, A., Agarwal, S., et al.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)

    Article  Google Scholar 

  11. Harman, M.: Making the case for MORTO: multi objective regression test optimization. In: ICST Workshops, pp. 111–114 (2011)

    Google Scholar 

  12. Sun, W., Gao, Z., Yang, W., et al.: Multi-objective test case prioritization for GUI applications. In: Proceedings of the 28th Annual ACM Symposium on Applied Computing. pp. 1074–1079. ACM (2013)

    Google Scholar 

  13. Snchez, A.B., Segura, S., Ruiz-Corts, A.A.: Comparison of test case prioritization criteria for software product lines. In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation (ICST), pp. 41–50. IEEE (2014)

    Google Scholar 

  14. Li, Z., Bian, Y., Zhao, R., Cheng, J.: A fine-grained parallel multi-objective test case prioritization on GPU. In: Ruhe, G., Zhang, Y. (eds.) SSBSE 2013. LNCS, vol. 8084, pp. 111–125. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  15. Epitropakis, M.G., Yoo, S., Harman, M., Burke, E.K.: Empirical evaluation of pareto efficient multi-objective regression test case prioritisation. In: Proceedings of the 2015 International Symposium on Software Testing and Analysis, pp. 234–245. ACM (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CREST, Department of Computer Science, University College London, Malet Place, London, WC1E 6BT, UK

    Mark Harman & Yue Jia

  2. Department of Computer Science, Beijing University of Chemical Technology, Beijing, 100029, People’s Republic of China

    Yi Bian & Zheng Li

  3. Department of Computer Science, Brunel University London, Kingston Lane, Uxbridge, London, UB8 3PH, UK

    Serkan Kirbas

  4. Computer Engineering Department, Bogazici University, 34342, Bebek, Istanbul, Turkey

    Serkan Kirbas

Authors
  1. Yi Bian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Serkan Kirbas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mark Harman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yue Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zheng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yi Bian .

Editor information

Editors and Affiliations

  1. Federal University of Rio de Janeiro State, Rio de Janeiro, Brazil

    Márcio Barros

  2. Carleton University, Ottawa, Ontario, Canada

    Yvan Labiche

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Bian, Y., Kirbas, S., Harman, M., Jia, Y., Li, Z. (2015). Regression Test Case Prioritisation for Guava. In: Barros, M., Labiche, Y. (eds) Search-Based Software Engineering. SSBSE 2015. Lecture Notes in Computer Science(), vol 9275. Springer, Cham. https://doi.org/10.1007/978-3-319-22183-0_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-22183-0_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-22182-3

  • Online ISBN: 978-3-319-22183-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation