skip to main content
10.1145/2652524.2652579acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
research-article

Industrial evaluation of the impact of quality-driven release planning

Published:18 September 2014Publication History

ABSTRACT

Context: Product release decisions are often made ad hoc or not relying on up-to-date information from systematic and analysis-driven process. Often, too much emphasis solely is put into functionality, thereby neglecting the different quality aspects being important for the success of the product. Objective: For a case study project, we quantitatively measure the impact of the analytical and systematic release planning approach Q-EVOLVE II. Method: As an explorative and retrospective case study, we perform optimized planning scenarios and compare them with the actual baseline scenario. Results: For the case study project in an Austrian public health insurance institution, we demonstrate that the analytical and systematic approach Q-EVOLVE II results in a (1) reduced release time, (2) more features implemented in the same time, and (3) better final quality through increased testing activities and less defects slipping through at the time of release. Conclusion: In the context of the studied institution, analytical and systematic planning of product releases considering quality criteria is superior to ad hoc planning ignoring quality.

References

  1. G. Ruhe. Product Release Planning. CRC Press, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  2. T. Gorschek, S. Fricker, K. Palm, and S. Kunsman. A lightweight innovation process for software-intensive product development. IEEE Software 27, 37--45, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. B. Boehm and V. R. Basili. Software Defect Reduction Top Top 10 List, 34(1):135--137, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. C. Denger and T. Olsson. Quality assurance in requirements engineering, Engineering and managing software requirements. pp. 163--185, Springer, 2005.Google ScholarGoogle Scholar
  5. C. Ebert and S. Brinkkemper. Software product management - An industry evaluation. Journal of Systems and Software 2014 (in press). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. ISTQB. Standard glossary of terms used in software testing. Version 2.2. International Software Testing Qualifications Board, Glossary Working Party, 2012.Google ScholarGoogle Scholar
  7. E. Bjarnason, P. Runeson, M. Borg, M. Unterkalmsteiner, E. Engström, B. Regnell, G. Sabaliauskaite, A. Loconsole, T. Gorschek, and R. Feldt. Challenges and practices in aligning requirements with verification and validation: a case study of six companies. Empirical Software Engineering, online first, Springer, 2014.Google ScholarGoogle Scholar
  8. Z. A. Barmi, A. H. Ebrahimi, and R. Feldt. Alignment of requirements specification and testing: A systematic mapping study. Conference on Software Testing, Verification and Validation Workshops (ICSTW 2011), IEEE, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. Svahnberg, T. Gorschek, R. Feldt, R. Torkar, S. B. Saleem, B., and M. U. Shafique. A systematic review on strategic release planning models. Information and Software Technology, 52(3):237--248, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Ho, S. Shawanez, and G. Ruhe. A Prototype Tool Supporting When-to-release Decisions in Iterative Development. 2nd International Workshop on Release Engineering (RELENG), 2014.Google ScholarGoogle Scholar
  11. M. Lindgren, R. Land, C. Norström, and A. Wall. Towards a capability model for the software release planning process - Based on a multiple industrial case study. Product-Focused Software Process Improvement. Springer, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. G. Zorn-Pauli, B. Paech, B., T. Beck, H. Karey, and G. Ruhe. Analyzing an Industrial Strategic Release Planning Process--A Case Study at Roche Diagnostics. Requirements Engineering: Foundation for Software Quality, Springer, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. G. Du, J. McElroy, and G. Ruhe. A family of empirical studies to compare informal and optimization-based planning of software releases. Proceedings ESEM 2006, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. R. Berntsson Svensson, P. Lindberg Parker, and B. Regnell. A prototype tool for QUPER to support release planning of quality requirements, Workshop IWSPM 2011, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  15. P. Runeson, M. Höst, A. Rainer, and B. Regnell. Case Study Research in Software Engineering: Guidelines and Examples. John Wiley & Sons, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. ReleasePlanner, www.releaseplanner.com, last access on July 5, 2014.Google ScholarGoogle Scholar
  17. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, and A. Wesslén. Experimentation in software engineering. Springer, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. A. Wood, Software reliability growth models: assumptions vs. reality, Proceedings International Symposium on Software Reliability Engineering. IEEE, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. M. Nayebi, G. Ruhe. An Open Innovation Approach in Support of Product Release Decisions. CHASE 2014 (Co-located Workshop at ICSE 2014), 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Industrial evaluation of the impact of quality-driven release planning

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          ESEM '14: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
          September 2014
          461 pages
          ISBN:9781450327749
          DOI:10.1145/2652524

          Copyright © 2014 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 18 September 2014

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          ESEM '14 Paper Acceptance Rate23of123submissions,19%Overall Acceptance Rate130of594submissions,22%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader