Skip to main content
SpringerLink
Log in

Experiences and Challenges of Introducing Risk-Based Testing in an Industrial Project

  • Conference paper
Book cover Software Quality. Increasing Value in Software and Systems Development (SWQD 2013)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 133))

Included in the following conference series:

Abstract

Risk-based testing has a high potential to improve the software test process as it helps to optimize the allocation of resources and provides decision support for the management. But for many organizations the integration of risk-based testing into an existing test process is a challenging task. In this paper we present a generic risk-based testing methodology and a procedure how it can be introduced in a test process. Based on this procedure we derive four stages of risk-based test integration, i.e., initial risk-based testing, risk-based test reporting, risk-based test planning, and optimization of risk-based testing. We then discuss how this procedure could be applied based on an industrial project and identify several challenges and lessons learned in introducing risk-based testing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 72.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. ISTQB: Standard glossary of terms used in software testing. Version 2.1 (2010)

    Google Scholar 

  2. Gerrard, P., Thompson, N.: Risk Based E-Business Testing. Artech House. Inc., Norwood (2002)

    Google Scholar 

  3. Felderer, M., Haisjackl, C., Breu, R., Motz, J.: Integrating Manual and Automatic Risk Assessment for Risk-Based Testing. Software Quality Days, 159–180 (2012)

    Google Scholar 

  4. Cavano, J.P., McCall, J.A.: A framework for the measurement of software quality. ACM SIGMETRICS Performance Evaluation Review 7(3-4), 133–139 (1978)

    Article  Google Scholar 

  5. ISO: ISO/IEC 25000 Software and system engineering-Software product Quality Requirements and Evaluation (SQuaRE)-Guide to SQuaRE. International Organization for Standarization (2005)

    Google Scholar 

  6. van Veenendaal, E., Goslin, A., Olsen, K., O’Hara, F., Miller, M., Thompson, G., Wells, B.: Test Maturity Model integration (TMMi) Version 1.0, TMMi Foundation (2008)

    Google Scholar 

  7. van Veenendaal, E.: The PRISMA Approach, Uitgeverij Tutein Nolthenius (2012)

    Google Scholar 

  8. Ramler, R., Kopetzky, T., Platz, W.: Value-Based Coverage Measurement in Requirements-Based Testing: Lessons Learned from an Approach Implemented in the TOSCA Testsuite. In: 38th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2012 (2012)

    Google Scholar 

  9. Cangussu, J.W., Karcich, R.M., Mathur, A.P., DeCarlo, R.A.: Software release control using defect based quality estimation. In: 15th International Symposium on Software Reliability Engineering (2004)

    Google Scholar 

  10. Fenton, N.E., Ohlsson, N.: Quantitative analysis of faults and failures in a complex software system. IEEE Transactions on Software Engineering 26(8), 797–814 (2000)

    Article  Google Scholar 

  11. Pfleeger, S.L.: Risky business: what we have yet to learn about risk management. Journal of Systems and Software 53(3), 265–273 (2000)

    Article  Google Scholar 

  12. Karolak, D.W., Karolak, N.: Software Engineering Risk Management: A Just-in-Time Approach. Wiley-IEEE Computer Society Press (1995)

    Google Scholar 

  13. Amland, S.: Risk-based testing: Risk analysis fundamentals and metrics for software testing including a financial application case study. Journal of Systems and Software 53(3), 287–295 (2000)

    Article  Google Scholar 

  14. Bach, J.: Heuristic risk-based testing. Software Testing and Quality Engineering Magazine 11, 99 (1999)

    Google Scholar 

  15. Redmill, F.: Exploring risk-based testing and its implications. Softw. Test. Verif. Reliab. 14(1), 3–15 (2004)

    Article  Google Scholar 

  16. Redmill, F.: Theory and practice of risk-based testing: Research Articles. Softw. Test. Verif. Reliab. 15(1), 3–20 (2005)

    Article  Google Scholar 

  17. Stallbaum, H., Metzger, A.: Employing Requirements Metrics for Automating Early Risk Assessment. In: Workshop on Measuring ss, pp. 1–12 (2007)

    Google Scholar 

  18. Ramler, R., Biffl, S., Grünbacher, P.: Value-based Management of Software Testing. In: Biffl, S., Aurum, A., Boehm, B., Erdogmus, H., Grünbacher, P. (eds.) Value-Based Software Engineering, pp. 225–244. Springer (2006)

    Google Scholar 

  19. Li, Q., Li, M., Yang, Y., Wang, Q., Tan, T., Boehm, B., Hu, C.: Bridge the Gap between Software Test Process and Business Value: A Case Study. In: Wang, Q., Garousi, V., Madachy, R., Pfahl, D. (eds.) ICSP 2009. LNCS, vol. 5543, pp. 212–223. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  20. Li, Q., Yang, Y., Li, M., Wang, Q., Boehm, B., Hu, C.: Improving Software Testing Process: Feature Prioritization to Make Winners of Success-critical Stakeholders. J. Softw. Maint. Evol. Res. Pract. (2010)

    Google Scholar 

  21. Wiegers, K.E.: First things first: Prioritizing requirements. Software Development 7(10), 24–30 (1999)

    Google Scholar 

  22. Saaty, T.L.: The Analytic Hierarchy Process. McGraw-Hill (1980)

    Google Scholar 

  23. Spillner, A., Rossner, T., Winter, M., Linz, T.: Software Testing Practice: Test Management: A Study Guide for the Certified Tester Exam ISTQB Advanced Level, Rocky Nook (2007)

    Google Scholar 

  24. Black, R.: Advanced Software Testing. Guide to the ISTQB Advanced Certification as an Advanced Test Manager, vol. 2. Rocky Nook (2009)

    Google Scholar 

  25. Ahern, D., Clouse, A., Turner, R.: CMMI distilled: a practical introduction to integrated process improvement. Addison-Wesley Professional (2008)

    Google Scholar 

  26. Dorling, A.: SPICE: Software process improvement and capability determination. Software Quality Journal 2(4), 209–224 (1993)

    Article  Google Scholar 

  27. Steiner, M., Blaschke, M., Philipp, M., Schweigert, T.: Make Test Process Assessment Similar to Software Process Assessment–the Test SPICE Approach. Journal of Software: Evolution and Process 24(5), 471–480 (2012)

    Article  Google Scholar 

  28. Koomen, T., Pol, M.: Test process improvement: a practical step-by-step guide to structured testing. Addison-Wesley Professional (1999)

    Google Scholar 

  29. Koomen, T., van der Aalst, L., Broekman, B., Vroon, M.: TMap Next, For Result-driven Testing. UTN Publishers (2006)

    Google Scholar 

  30. Ramler, R., Larndorfer, S., Natschläger, T.: What Software Repositories Should Be Mined for Defect Predictors? In: 35th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2009 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computer Science, University of Innsbruck, Austria

    Michael Felderer

  2. Software Competence Center Hagenberg, Austria

    Rudolf Ramler

Authors
  1. Michael Felderer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rudolf Ramler
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Software Technology and Interactive Systems, Vienna University of Technology, Vienna, Austria

    Dietmar Winkler  & Stefan Biffl  & 

  2. Software Quality Lab GmbH, Linz, Austria

    Johannes Bergsmann

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Felderer, M., Ramler, R. (2013). Experiences and Challenges of Introducing Risk-Based Testing in an Industrial Project. In: Winkler, D., Biffl, S., Bergsmann, J. (eds) Software Quality. Increasing Value in Software and Systems Development. SWQD 2013. Lecture Notes in Business Information Processing, vol 133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35702-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35702-2_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35701-5

  • Online ISBN: 978-3-642-35702-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation