Skip to main content

First Steps towards Validating a Cost-Benefit Model of Reviews and Tests

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5338))

Abstract

Software project managers’ decisions on reviews and tests are difficult. This paper describes a cost-benefit model for specific decisions on quality assurance. The quantitative model is based on single relationships and is quantified with historical data. Its results are shown and are compared with cost estimations. The model is able to reflect reported results of process improvement. Data collected in student projects is used to evaluate the model. Project averages and single projects are considered. Furthermore, results of a cross-validation are shown.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Biffl, S.: Software Inspection Techniques to Support Project and Quality Management, Habilitationsschrift. Shaker Verlag (2001)

    Google Scholar 

  2. Biffl, S., Halling, M.: Investigating the Influence of Inspector Capability Factors with Four Inspection Techniques on Inspection Performance. In: Proc. of METRICS 2002 (2002)

    Google Scholar 

  3. Biffl, S., Halling, M.: Investigating the Defect Detection Effectiveness and Cost Benefit of Nominal Inspection Teams. IEEE Trans. on Softw. Eng. 29(5) (2003)

    Google Scholar 

  4. Boehm, B.W.: Software Engineering Economics. Prentice Hall, Englewood Cliffs (1981)

    MATH  Google Scholar 

  5. Boehm, B.W.: Software Cost Estimation with COCOMO II. Prentice Hall, Englewood Cliffs (2000)

    Google Scholar 

  6. Boehm, B.W., Huang, L., Jain, A., Madachy, R.: The ROI of Software Dependability: The iDave Model. IEEE Softw. 21(3) (2004)

    Google Scholar 

  7. Bossel, H.: Systeme, Dynamik, Simulation. Books on Demand (2004)

    Google Scholar 

  8. Cangussu, J.W., Mathur, A.P., Karcich, R.M., DeCarlo, R.A.: Software Release Control using Defect Based Quality Estimation. In: Proc. of ISSRE 2004 (2004)

    Google Scholar 

  9. Cuadrado-Gallego, J.J., Fernandez-Sanz, L., Sicilia, M.-A.: Enhancing Input Value Selection in Parametric Software Cost Estimation Models through Second Level Cost Drivers. Software Quality Journal 14(4) (2006)

    Google Scholar 

  10. Dahl, O.-J., Dijkstra, E.W., Hoare, C.A.R.: Structured Programming. Academic Press, London (1972)

    MATH  Google Scholar 

  11. Diaz, M., King, J.: How CMM Impacts Quality, Productivity, Rework, and the Bottom Line. CrossTalk (March 2002)

    Google Scholar 

  12. Drappa, A., Deininger, M., Ludewig, J., Melchisedech, R.: Modeling and Simulation of Software Projects. In: Proc. of the 20th Annual Softw. Eng. Workshop (1995)

    Google Scholar 

  13. El Emam, K.: The ROI from Software Quality. Auerbach Publications (2005)

    Google Scholar 

  14. Endres, A., Rombach, H.D.: A Handbook of Software and Systems Engineering. Empirical Observations, Laws and Theories. Pearson, London (2003)

    Google Scholar 

  15. Fagan, M.E.: Advances in Software Inspections. IEEE Trans. on Softw. Eng. SE-12(7) (1986)

    Google Scholar 

  16. Fenton, N.E., Pfleeger, S.L.: Software Metrics. A Rigorous & Practical Approach, 2nd edn. PWS Publishing Company (1997)

    Google Scholar 

  17. Freedman, D.P., Weinberg, G.M.: Handbook of Walkthroughs, Inspections, and Technical Reviews, 3rd edn. Little, Brown and Company (1982)

    Google Scholar 

  18. Freimut, B., Briand, L.C., Vollei, F.: Determining Inspection Cost-Effectiveness by Combining Project Data and Expert Opinion. IEEE Trans. on Softw. Eng. 31(12) (2005)

    Google Scholar 

  19. Grady, R.B.: Practical Software Metrics for Project Management and Process Improvement. Prentice Hall, Englewood Cliffs (1992)

    Google Scholar 

  20. Haley, T., Ireland, B., Wojtaszek, E., Nash, D., Dion, R.: Raytheon Electronic Systems Experience in Software Process Improvement. CMU/SEI-95-TR-017 (1995)

    Google Scholar 

  21. Hampp, T., Knauß, M.: Eine Untersuchung über Korrekturkosten von Software-Fehlern. Softwaretechnik-Trends 28(2) (2008)

    Google Scholar 

  22. Huang, C.-Y., Lyu, M.R.: Optimal Release Time for Software Systems Considering Cost, Testing-Effort, and Test Efficiency. IEEE Trans. on Reliability 54(4) (2005)

    Google Scholar 

  23. Jalote, P.: CMM in Practice: Processes for Executing Software Projects at Infosys. Addison-Wesley, Reading (2000)

    Google Scholar 

  24. Jones, C.: Applied Software Measurement. 2nd edn. McGraw-Hill, New York (1997)

    Google Scholar 

  25. Jones, C.: Estimating Software Costs. McGraw-Hill, New York (2007)

    Google Scholar 

  26. Kan, S.H.: Metrics and Models in Software Quality Engineering, 2nd edn. Addison-Wesley, Reading (2003)

    MATH  Google Scholar 

  27. Kemerer, C.F.: An Empirical Validation of Software Cost Estimation Models. Comm. of the ACM 30(5) (1987)

    Google Scholar 

  28. Kusumoto, S., Matsumoto, K., Kikuno, T., Torii, K.: A New Metrics for Cost Effectiveness of Software Reviews. IEICE Trans. on Inf. and Syst. E75-D(5) (1992)

    Google Scholar 

  29. Liggesmeyer, P.: Software-Qualität. Spektrum (2002)

    Google Scholar 

  30. Ludewig, J. (ed.): Praktische Lehrveranstaltungen im Studiengang Softwaretechnik. Bericht der Fakultät Informatik, Universität Stuttgart, 2nd edn. (2001)

    Google Scholar 

  31. Martin, R., Raffo, D.M.: Application of a Hybrid Process Simulation Model to a Software Development Project. Journal of Systems and Software 59(3) (2001)

    Google Scholar 

  32. Mizuno, O., Shigematsu, E., Takagi, Y., Kikuno, T.: On Estimating Testing Effort Needed to Assure Field Quality in Software Development. In: Proc. of ISSRE 2002 (2002)

    Google Scholar 

  33. Müller, M.: Analyzing Software Quality Assurance Strategies through Simulation. Dissertation, Fraunhofer IESE (2007)

    Google Scholar 

  34. Piwowarski, P., Ohba, M., Caruso, J.: Coverage Measurement Experience During Function Test. In: Proc. of ICSE 1993 (1993)

    Google Scholar 

  35. Rubey, R.J., Browning, L.A., Roberts, A.R.: Cost Effectiveness of Software Quality Assurance. In: Proc. of NAECON (1989)

    Google Scholar 

  36. Van Megen, R., Meyerhoff, D.B.: Costs and Benefits of Early Defect Detection: Experiences from Developing Client Server and Host Applications. Software Quality Journal 4(4) (1995)

    Google Scholar 

  37. Wagner, S.: Cost-Optimisation of Analytical Software Quality Assurance. Dissertation, TU München (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hampp, T. (2008). First Steps towards Validating a Cost-Benefit Model of Reviews and Tests. In: Dumke, R.R., Braungarten, R., Büren, G., Abran, A., Cuadrado-Gallego, J.J. (eds) Software Process and Product Measurement. Mensura MetriKon IWSM 2008 2008 2008. Lecture Notes in Computer Science, vol 5338. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89403-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89403-2_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89402-5

  • Online ISBN: 978-3-540-89403-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics