Skip to main content
SpringerLink
Log in

Test Process Models: Systematic Literature Review

  • Conference paper
Software Process Improvement and Capability Determination (SPICE 2014)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 477))

Abstract

Software products quality is strongly influenced by the quality of the process that generated them; particularly, the testing process contributes to product quality and represents a significant effort in software development projects. In this context, this study aim to find which test process models has been defined, adapted or extended in software industry from 1990 to the current date. For this purpose, a systematic literature review has been performed according to relevant guidelines. This study has identified 23 test process models, many of them adapted or extended from TMMi and TPI, which have different architectures and the new ISO/IEC 29119 with an architectural approach aligned to other ISO/IEC software process models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Petersen, K., Feldt, R., Mujtaba, S., Mattsson, M.: Systematic Mapping Studies in Software Engineering. In: 12th International Conference on Evaluation and Assessment in Software Engineering, vol. 17, pp. 68–77 (2008)

    Google Scholar 

  2. Kitchenham, B.A., Charters, S.: Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01 (2007)

    Google Scholar 

  3. Softex: MPS.BR - Melhoria de Processo do Software Brasileiro Guia Geral MPS de Software (2012)

    Google Scholar 

  4. Kollanus, S., Koskinen, J.: Survey of Software Inspection Research. The Open Software Engineering Journal 3, 15–34 (2009)

    Article  Google Scholar 

  5. Humphrey, W.S.: Managing the Software Process. Addison-Wesley Professional (1989)

    Google Scholar 

  6. Kitchenham, B.A., Budgen, D., Brereton, P.: Using mapping studies as the basis for further research–a participant-observer case study. Information and Software Technology 53(6), 638–651 (2011)

    Article  Google Scholar 

  7. Bertolino, A.: Software Testing Research: Achievements, Challenges, Dreams. In: Future of Software Engineering, pp. 85–103. IEEE Computer Society (2007)

    Google Scholar 

  8. Paulk, M.C.: Surviving the Quagmire of Process Models, Integrated Models, and Standards. In: Annual Quality Congress Proceedings, Toronto, Ontario, Canada, pp. 429–438. Carnegie Mellon University, Pittsburgh (2004)

    Google Scholar 

  9. Wangenheim, C.G., Hauck, J.C.R., Salviano, C.F., Wangenheim, A.: Systematic Literature Review of Software Process Capability/Maturity Models. In: Proceedings of International Conference on Software Process Improvement and Capabity Determination (SPICE), Pisa, Italy (2010)

    Google Scholar 

  10. Software Testing Standard., http://www.softwaretestingstandard.org/

  11. Moore, J.W.: An integrated collection of software engineering standards. IEEE Software 16(6), 51–57 (1999)

    Article  Google Scholar 

  12. Toroi, T., Raninen, A., Vaatainen, L.: Identifying Process Improvement Targets in Test Processes: A Case Study. In: 29th IEEE International Conference on Software Maintenance (ICSM), pp. 11–19 (2013)

    Google Scholar 

  13. Brereton, P., Kitchenham, B.A., Budgen, D., Turner, M., Khalil, M.: Lessons from Apply-ing the Systematic Literature Review Process within the Software Engineering Domain. The Journal of Systems and Software 80(4), 571–583 (2007)

    Article  Google Scholar 

  14. Swinkels, R.: A Comparison of TMM and other Test Process Improvement Models. Tech-nical Report Frits Philips Institute, Technische Universiteit, Eidhoven, Netherlands (2000)

    Google Scholar 

  15. Kim, E., Jang, Y.: A test improvement model for embedded software testing. In: Proceedings of the 11th IASTED International Conference on Software Engineering and Applications, pp. 79–84. ACTA Press (2007)

    Google Scholar 

  16. Heiskanen, H., Maunumaa, M., Katara, M.: A Test Process Improvement Model for Automated Test Generation. In: Dieste, O., Jedlitschka, A., Juristo, N. (eds.) PROFES 2012. LNCS, vol. 7343, pp. 17–31. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  17. Reid, S.C.: BS 7925-2: The Software Component Testing Standard. In: Proceedings of First Asia-Pacific Conference on Quality Software, pp. 139–148. IEEE (2000)

    Google Scholar 

  18. Black, R.: Critical Testing Processes: Plan, Prepare, Perform, Perfect. Addison-Wesley Professional (2004)

    Google Scholar 

  19. ISO/IEC: ISO/IEC/IEEE 29119-2:2013 Software and systems engineering – Software test-ing – Part 2: Test processes. Geneva (2013)

    Google Scholar 

  20. Veenendaal, E., Evans, I., Black, R.: Foundations of Software Testing: ISTQB Certifica-tion. Course Technology Cengage Learning (2008)

    Google Scholar 

  21. Jacobs, J.C., Trienekens, J.J.M.: Towards a Metrics Based Verification and Val-idation Maturity Model. In: Proceedings of 10th International Workshop on Software Technology and Engineering Practice, STEP 2002, pp. 123–128. IEEE (2002)

    Google Scholar 

  22. Steiner, M., Blaschke, M., Philipp, M., Schweigert, T.: Make Test Process As-sessment Similar to Software Process Assessment—the Test SPICE Approach. Journal of Software Maintenance and Evolution Research and Practice

    Google Scholar 

  23. Furtado, A.P.C.C., Gomes, M.A.W., Andrade, E.C., de Farias, I.H.: MPT. BR: A Brazilian Maturity Model for Testing. In: 12th International Conference on Quality Software (QSIC), pp. 220–229. IEEE (2012)

    Google Scholar 

  24. Hetzel, W.C., Hetzel, B.: The Complete Guide to Software Testing. QED Information Sciences, Wellesley (1988)

    Google Scholar 

  25. Eldh, S., Andersson, K., Ermedahl, A., Wiklund, K.: Towards a Test Automation Im-provement Model (TAIM). In: 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 337–342. IEEE (2014)

    Google Scholar 

  26. Jacobs, J., van Moll, J., Stokes, T.: The Process of Test Process Improvement. XOOTIC Magazine 8(2), 23–29 (2000)

    Google Scholar 

  27. ISO/IEC ISO/IEC 12207:2008 Systems and software engineering — Software life cycle processes, Geneva (2008)

    Google Scholar 

  28. Steiner, M., Blaschke, M., Philipp, M., Schweigert, T.: Make test process assessment similar to software process assessment—the Test SPICE approach. Journal of Software: Evo-lution and Process 24(5), 471–480 (2012)

    Google Scholar 

  29. Ericson, T., Subotic, A., Ursing, S.: TIM - A Test Improvement Model. Software Testing, Verification and Reliability 7(4), 229–246 (1997)

    Article  Google Scholar 

  30. Burnstein, I., Suwanassart, T., Carlson, R.: Developing a testing maturity model for soft-ware test process evaluation and improvement. In: Proceeding of International Test Conference, pp. 581–589. IEEE (1996)

    Google Scholar 

  31. IBM, Rational Unified Process, IBM Rational Method Composer, Version 7.1.1

    Google Scholar 

  32. SEI: CMMI for Development, Version 1.3, CMU/SEI-2010-TR-033 (November 2010)

    Google Scholar 

  33. SOGETI: TPI Next – Business Driven Test Process Improvement. UTN Publishers (2009)

    Google Scholar 

  34. Koomen, T., Pol, M.: Test Process Improvement: A practical step-by-step guide to struc-tured testing. Addison-Wesley Longman Publishing Co., Inc. (1999)

    Google Scholar 

  35. Jung, E.: A test process improvement model for embedded software developments. In. 9th International Conference on Quality Software, QSIC 2009, pp. 432–437. IEEE (2009)

    Google Scholar 

  36. Heiskanen, H., Maunumaa, M., Katara, M.: Test Process Improvement for Au-tomated Test Generation. Tampere: Tampere University of Technology, Department of Software Systems (2010)

    Google Scholar 

  37. Kulkarni, S.: Test Process Maturity Models–Yesterday, Today and Tomorrow. In: Proceedings of the 6th Annual International Software Testing Conference, Delhi, India (2006)

    Google Scholar 

  38. Zhang, L.: The software test improvement model in practice (2005)

    Google Scholar 

  39. Karlström, D., Runeson, P., Norden, S.: A minimal test practice framework for emerging software organizations. Software Testing, Verification and Reliability 15(3), 145–166 (2005)

    Article  Google Scholar 

  40. SOGETI: TPI Automotive. Tech. Rep. version 1.01 (2004), http://www.tpiautomotive.de/produkte.html (visited June 2014)

  41. Oktaba, H., Alquicira C., Su A.: Modelo de Procesos para la Industria de Softwa-re, Mo-ProSoft. Versión 1.3 (2005)

    Google Scholar 

  42. Veenendaal, E.: Test Maturity Model Integration (TMMi). Version1.0. TMMi Foundation (2008), http://www.tmmifoundation.org/html/tmmiorg.html (last access June 2014)

  43. ISTQB. Improving the Testing Process - ISTQB® International Software Testing Qualifi-cation Board, http://www.istqb.org

  44. Suwanassart, B.T., Carlson, C.R.: Developing a testing maturity model (part 1). CrossTalk, Journal of Defense Software Engineering 9(8), 21–24 (1996)

    Google Scholar 

  45. Burstein, I., Suwannasart, T., Carlson, C.R.: Developing a testing maturity model, part II. Crosstalk The Journal of Defense Software Engineering (1996)

    Google Scholar 

  46. Gelperin, D., Hetzel, B.: The growth of software testing. Communications of the ACM 31(6), 687–695 (1988)

    Article  Google Scholar 

  47. ISTQB. International Software Testing Qualification Board, http://istqb.org/

  48. Reid, S.: The Personal Test Maturity Matrix. In: CAST 2006: Influencing the Practice, Indianapolis, June 5-7, vol. 133 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Posgraduate School, Pontificia Universidad Católica del Perú, Lima, Perú

    Cecilia Garcia

  2. Engineering Department, Pontificia Universidad Católica del Perú, Lima, Perú

    Abraham Dávila

  3. Polytechnic School, University of Sao Paulo, Sao Paulo, Brasil

    Marcelo Pessoa

Authors
  1. Cecilia Garcia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abraham Dávila
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marcelo Pessoa
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Vilnius University, Vilnius, Lithuania

    Antanas Mitasiunas

  2. Griffith University, Brisbane, Queensland, Australia

    Terry Rout

  3. Dublin City University, Ireland

    Rory V. O’Connor

  4. InterSPICE Ltd, Cambridge, UK

    Alec Dorling

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Garcia, C., Dávila, A., Pessoa, M. (2014). Test Process Models: Systematic Literature Review. In: Mitasiunas, A., Rout, T., O’Connor, R.V., Dorling, A. (eds) Software Process Improvement and Capability Determination. SPICE 2014. Communications in Computer and Information Science, vol 477. Springer, Cham. https://doi.org/10.1007/978-3-319-13036-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-13036-1_8

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-13035-4

  • Online ISBN: 978-3-319-13036-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation