Skip to main content
Log in

A critical look at ISO 9000 for software quality management

  • Published:
Software Quality Journal Aims and scope Submit manuscript

Abstract

A considerable number of software suppliers report improvements in product and service quality, development costs and time to market achieved with the help of the ISO 9000 standards. Nevertheless, the ISO 9000 family has received unfavourable criticism in journals, textbooks and at software quality conferences. The paper summarizes, discusses and reviews eleven of the most popular arguments against the ISO 9000 standards. The review of the criticism is based on findings of two empirical surveys among European software suppliers that have implemented an ISO 9000 quality system. The paper concludes with suggestions and guidelines for advances in software quality management concepts, such as the ISO 9000 family, CMM, BOOTSTRAP and the emerging SPICE standard.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. ISO 9000-1 Quality management and quality assurance standards, Part 1: Guidelines for selection and use (ISO, Geneva, 1994).

    Google Scholar 

  2. ISO 9001 Quality systems. Model for quality assurance in design, development, production, installation and servicing (ISO, Geneva, 1994).

    Google Scholar 

  3. ISO 9002 Quality systems. Model for quality assurance in production, installation and servicing (ISO, Geneva, 1994).

    Google Scholar 

  4. ISO 9003 Quality systems. Model for quality assurance in final inspection and test (ISO, Geneva, 1994).

    Google Scholar 

  5. ISO 9000-2 Quality management and quality assurance standards, Part 2: Generic guidelines for the application of ISO 9001, ISO 9002 and ISO 9003 (ISO, Geneva, 1993).

    Google Scholar 

  6. ISO 9000-3 Quality management and quality assurance standards, Part 3: Guidelines for the application of ISO 9001 to the development, supply and maintenance of software (ISO, Geneva, 1992).

    Google Scholar 

  7. ISO 9004-1 Quality management and quality system elements, Part 1: Guidelines (ISO, Geneva, 1994).

    Google Scholar 

  8. G. Bellin and D. Stelzer. Softwarequalitaetsmanagement gemaeß ISO 9000. Ergebnisse einer empirischen Untersuchung zertifizierter Qualitaetsmanagementsysteme.(Studien zur Systementwicklung des Lehrstuhls fuer Wirtschaftsinformatik der Universitaet zu Koeln, Koeln, 1995).

  9. D. Stelzer. Interpretation der ISO 9000-Familie bei der Zertifizierung von Qualitaetsmanagement-systemen fuer die Softwareentwicklung, in Qualitaetsmanagement und Software: ISO 9000 - Softwareentwicklung - Ethik - Analysen - Tools, N. Ruppenthal and U. Sigor, (eds) (Lit Verlag, Muenster, 1995).

  10. D. Stelzer, W. Mellis and G. Herzwurm. Software process improvement via ISO 9000? Results of two surveys among European software houses, in Proceedings of the Twenty-Ninth Annual Hawaii International Conference on System Sciences, 3-6 January, 1996, Wailea, Hawaii, USA, Volume 1. Software Technology and Architecture, H. El-Rewini and B.D. Shriver, (eds) (IEEE Computer Society Press, Washington, 1996) pp. 703-712.

    Google Scholar 

  11. ISO 9004-4 Quality management and quality system elements, Part 4: Guidelines for quality improvement (ISO, Geneva, 1993).

    Google Scholar 

  12. P. Haynes and S. Meyn. Is ISO 9000 going to put you out of business? American Programmer, 7(9), 25-29, 1994.

    Google Scholar 

  13. J. Herbsleb, A. Carleton, J. Rozum, J. Siegel and D. Zubrow. Benefits of CMM-based software process improvement: initial results (Technical Report, CMU/SEI-94-TR-13. ESC-TR-94-013, Pittsburgh, 1994).

  14. T. Matsubara. Does ISO 9000 really help improve software quality? American Programmer, 7(2), 38–45, 1994.

    Google Scholar 

  15. F. Coallier. How ISO 9001 fits into the software world, IEEE Software, 11, 98-100, 1994.

    Google Scholar 

  16. M. Paulk, B. Curtis, M. Chrissis and C. Weber. Capability Maturity Model for Software, Version 1.1 (Technical Report CMU/SEI-93-TR-024, Pittsburgh, 1993).

  17. D.E. Avison, H.U. Shah and D.N. Wilson. Software Quality standards in practice: the limitations of using ISO-9001 to support software development, Software Quality Journal, 3, 105–111, 1994.

    Google Scholar 

  18. Y. Iizuka. Is TQM Effective for Software Quality?, in Proceedings of the First World Congress for Software Quality, 20-22 June, 1995, San Francisco, CA, American Society for Quality Control (ASQC), European Organization for Quality (EOQ), Society for Software Quality-USA (SSQ), Union of Japanese Scientists and Engineers (JUSE) (eds.) (ASQC, San Francisco, 1995) pp. 1-10.

    Google Scholar 

  19. M. Vering and V. Haentjes. Ist ISO 9000 ein geeignetes Werkzeug für Process Engineering? Ein Erfahrungsbericht aus der SAP-Entwicklung. Management & Computer, 3(2), 85-90, 1995.

    Google Scholar 

  20. Department of Trade and Industry (DTI), British Standards Institute (BSI) TickIT - making a better job of software. Guide to Software Quality Management System Construction and Certification using EN 29001.Issue 3.0. (DTI, BSI, London, 1995).

    Google Scholar 

  21. ITQS European Information Technology Quality System Auditor Guide (ITQS, Brussels, 1992).

    Google Scholar 

  22. M. Paulk. Basis of contrast between ISO 9001 and SEI Capability Maturity Model challenged. IEEE Computer, 26(10), 81–82, 1993.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Stelzer, D., Mellis, W. & Herzwurm, G. A critical look at ISO 9000 for software quality management. Software Quality Journal 6, 65–79 (1997). https://doi.org/10.1023/A:1018591430752

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1018591430752

Navigation