Skip to main content

Developing and Applying a Consolidated Evaluation Framework to Analyze Test Process Improvement Approaches

  • Conference paper
Software Process and Product Measurement (Mensura 2007, IWSM 2007)

Abstract

Following the general software process improvement initiatives, improvement models particular to the software test process have also been developed. Although these models have been based on nearly similar principles, yet they differ in a variety of aspects. To compare and critically analyze strengths and weaknesses of these test process models, we need a common analysis framework. Existing SPI evaluation frameworks focus only on some basic and key process characteristics and elements. A number of critical success factors for software process improvement have been identified in literature which impose higher level of requirements on SPI approaches. We present a consolidated evaluation framework derived from critical success factors/literature review and apply it to analyze well known test process improvement approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wang, Y., King, G.: Software engineering processes: principles and applications. CRC Press, Inc., Boca Raton (2000)

    Google Scholar 

  2. Komi-Sirviö, S.: Development and Evaluation of Software Process Improvement Methods. PhD thesis, Faculty of Science, University of Oulu, Oulu, Finland (2004), http://www.vtt.fi/inf/pdf/publications/2004/P535.pdf

  3. Braungarten, R.: The SMPI model: A stepwise process model to facilitate software measurement process improvement along the measurement paradigms. PhD thesis, University of Magdeburg, Magdeburg, Germany (2007)

    Google Scholar 

  4. Burnstein, I.: Practical Software Testing: A Process-oriented Approach. Springer Inc., New York (2003)

    MATH  Google Scholar 

  5. Jacobs, J.C., Trienekens, J.J.M.: Towards a metrics based verification and validation maturity model. In: STEP 2002: Proceedings of the 10th International Workshop on Software Technology and Engineering Practice, p. 123. IEEE Computer Society Press, Washington (2002)

    Google Scholar 

  6. Ericson, T., Subotic, A., Ursing, S.: TIM a test improvement model. J. Softw. Test., Verif. Reliab. 7(4), 229–246 (1998)

    Article  Google Scholar 

  7. Farooq, A., Hegewald, H., Dumke, R.R.: A critical analysis of the Testing Maturity Model. Metrics News, Journal of GI-Interest Group on Software Metrics 12(1), 35–40 (2007)

    Google Scholar 

  8. Swinkels, R.: A comparison of TMM and other test process improvement models. Technical report, Frits Philips Institute, Technische Universiteit Eindhoven, Netherlands (2000), http://is.tm.tue.nl/research/v2m2/wp1/12-4-1-FPdef.pdf

  9. Kulkarni, S.: Test process maturity models - yesterday, today and tomorrow. In: Proceedings of the 6th Annual International Software Testing Conference in India (2006)

    Google Scholar 

  10. Saiedian, H., Chennupati, K.: Towards an evaluative framework for software process improvement models. J. Syst. Softw. 47(2–3), 139–148 (1999)

    Article  Google Scholar 

  11. Halvorsen, C.P., Conradi, R.: A taxonomy to compare SPI frameworks. In: Ambriola, V. (ed.) EWSPT 2001. LNCS, vol. 2077, pp. 217–235. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  12. Dyba, T.: An empirical investigation of the key factors for success in software process improvement. IEEE Trans. Softw. Eng. 31(5), 410–424 (2005)

    Article  Google Scholar 

  13. Niazi, M., Wilson, D., Zowghi, D.: Critical success factors for software process improvement implementation: an empirical study. Software Process: Improvement and Practice 11(2), 193–211 (2006)

    Article  Google Scholar 

  14. Wilson, D.N., Hall, T., Baddoo, N.: A framework for evaluation and prediction of software process improvement success. J. Syst. Softw. 59(2), 135–142 (2001)

    Article  Google Scholar 

  15. Conradi, R., Fuggetta, A.: Improving software process improvement. IEEE Software 19(4), 92–99 (2002)

    Article  Google Scholar 

  16. Humphrey, W.S.: Managing the software process. Addison-Wesley Longman Publishing Co., Inc, Boston (1989)

    Google Scholar 

  17. van Solingen, R.: Product Focused Software Process Improvement: SPI in the Embedded Software Domain. PhD thesis, Eindhoven University of Technology, Eindhoven, The Netherlands (2000), http://alexandria.tue.nl/extra2/200000702.pdf

  18. Haug, M., Olsen, E.W., Bergman, L.: Software Process Improvement: Metrics, Measurement and Process Modelling. Software Best Practice 4. Springer, Berlin, Germany (2001)

    Google Scholar 

  19. O’Hara, F.: European experiences with software process improvement. In: ICSE 2000: Proceedings of the 22nd international conference on Software engineering, pp. 635–640. ACM Press, New York (2000)

    Chapter  Google Scholar 

  20. Dumke, R.R., Braungarten, R., Blazey, M., Hegewald, H., Reitz, D., Richter, K.: Software process measurement and control - a measurement-based point of view of software processes. Technical report, Dept. of Computer Science, University of Magdeburg (2006)

    Google Scholar 

  21. Dumke, R.R., Hegewald, M.B.H., Reitz, D., Richter, K.: Causalities in software process measurement and improvement. In: MENSURA 2006: Proceedings of the International Conference on Software Process and Product Measurement, Cádiz, Spain, pp. 42–52. Servicio de Publicaciones de la Universidad de Cádiz (2006), http://paginaspersonales.deusto.es/cortazar/doctorado/articulos/2006/MENSURA2006Proceedings.pdf

  22. Pfleeger, S.L., Rombach, H.D.: Measurement based process improvement. IEEE Softw. 11(4), 8–11 (1994)

    Article  Google Scholar 

  23. Goldenson, D.R., Jarzombek, J., Rout, T.: Measurement and analysis in capability maturity model integration models and software process improvement. CrossTalk The Journal of Defense Software Engineering (2003), http://www.stsc.hill.af.mil/crosstalk/2003/07/goldenson.html

  24. Sommerville, I.: Software Engineering, 8th edn. Pearson Education Limited, Harlow, England (2007)

    MATH  Google Scholar 

  25. Abran, A., Bourque, P., Dupuis, R., Moore, J.W. (eds.): Guide to the Software Engineering Body of Knowledge - SWEBOK. IEEE Press, Piscataway (2004)

    Google Scholar 

  26. de Almeida Falbo, R., Borges, L.S.M., Valente, F.F.R.: Using knowledge management to improve software process performance in a CMM level 3 organization. In: QSIC 2004: Proceedings of the Fourth International Conference on Quality Software, pp. 162–169. IEEE Computer Society Press, Washington (2004)

    Chapter  Google Scholar 

  27. Kneuper, R.: Supporing software process using knowledge management. Handbook of Software Engineering and Knowledge Engineering (2001), http://cs.pitt.edu/chang/handbook/37b.pdf

  28. Rainer, A., Hall, T.: Key success factors for implementing software process improvement: a maturity-based analysis. J. Syst. Softw. 62(2), 71–84 (2001)

    Article  Google Scholar 

  29. Niazi, M., Wilson, D., Zowghi, D.: A model for the implementation of software process improvement: A pilot study. In: QSIC: Proceedings of the 3rd International Conference on Quality Software, pp. 196–203. IEEE Computer Society, Washington (2003)

    Google Scholar 

  30. Koomen, T.: Worldwide survey on Test Process Improvement. Technical report, Sogeti (2002)

    Google Scholar 

  31. Koomen, T.: Worldwide survey on Test Process Improvement. Technical report, Sogeti (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Juan J. Cuadrado-Gallego René Braungarten Reiner R. Dumke Alain Abran

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Farooq, A., Dumke, R.R. (2008). Developing and Applying a Consolidated Evaluation Framework to Analyze Test Process Improvement Approaches. In: Cuadrado-Gallego, J.J., Braungarten, R., Dumke, R.R., Abran, A. (eds) Software Process and Product Measurement. Mensura IWSM 2007 2007. Lecture Notes in Computer Science, vol 4895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85553-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85553-8_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85552-1

  • Online ISBN: 978-3-540-85553-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics