Skip to main content
SpringerLink
Log in

Software release and testing stop time decision with change point

  • Original Article
  • Published:
International Journal of System Assurance Engineering and Management Aims and scope Submit manuscript

Abstract

Information technology has seen enormous growth in the last few decades. The backbone of this growth is the developments in the software industry who is working day and night to meet all the expectations. As we know a reliable software can ease our work but developing reliable software may take a longer time. At the same time, huge market competition has forced firms to deliver reliable products as quick as possible as per the user’s expectation. Due to this trade-off between reliability and market competition firms have started releasing software products with the assurance that they will repair their products if any failure is detected while operating. Keeping this phenomenon in mind various researchers proposed a framework based on a different set of assumptions. During the software development at some point of time the rate of detection/removal changes due to various reasons such as a change in testing efficiency, team composition, the addition of extra testing team, etc. This change in the fault removal has an impact on the release and testing stop time of software. In this paper, we propose a software cost model to determine optimal software release and testing stop time considering the change in detection/removal rate before the release of the software. The proposed model is validated on real-life data set.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Arora A, Caulkins JP, Telang R (2006) Research note—Sell first, fix later: impact of patching on software quality. Manage Sci 52(3):465–471

    Google Scholar 

  • Cao P, Yang K, Liu K 2019) Optimal selection and release problem in software testing process: a continuous time stochastic control approach. Eur J Perat Res

  • Chatterjee S, Shukla A (2017) An ideal software release policy for an improved software reliability growth model incorporating imperfect debugging with fault removal efficiency and change point. Asia-Pacific J Oper Res 34(03):1740017

    MathSciNet  MATH  Google Scholar 

  • Chatterjee S, Singh JB (2014) A NHPP based software reliability model and optimal release policy with logistic–exponential test coverage under imperfect debugging. Int J Syst Assuran Eng Manag 5(3):399–406

    Google Scholar 

  • Choudhary C, Kapur PK, Khatri SK, Muthukumar R, Shrivastava AK (2020) Effort based release time of software for detection and correction processes using MAUT. Int J Syst Assuran Eng Manage. https://doi.org/10.1007/s13198-020-00955-2

    Article  Google Scholar 

  • Choudhary C, Kapur PK, Shrivastava AK, Khatri SK (2019) Effort based release and patching time with warranty using change point. Int J Performab Eng 15(6):1724–1733

    Google Scholar 

  • Choudhary C, Kapur PK, Shrivastava AK, Khatri SK (2018) Software release and patching time with warranty using change point. In: Kapur P, Kumar U, Verma A (eds) Quality, IT and business operations. Springer proceedings in business and economics. Springer, Singapore

  • Dohi T, Kaio N, Osaki S (1997) Optimal software release policies with debugging time lag. Int J Reliab Qual Saf Eng 4(03):241–255

    Google Scholar 

  • Etgar R, Gelbard R, Cohen Y (2017) Optimizing version release dates of research and development long-term processes. Eur J Oper Res 259(2):642–653

    MathSciNet  MATH  Google Scholar 

  • Goel AL, Okumoto K (1979) Time-dependent error-detection rate model for software reliability and other performance measures. IEEE Trans Reliab 28(3):206–211

    MATH  Google Scholar 

  • Ho JW, Fang CC, Huang YS (2008) The determination of optimal software release times at different confidence levels with consideration of learning effects. Softw Test Verific Reliab 18(4):221–249

    Google Scholar 

  • Hsu CJ, Huang CY, Chang JR (2011) Enhancing software reliability modeling and prediction through the introduction of time-variable fault reduction factor. Appl Math Model 35(1):506–521

    MATH  Google Scholar 

  • Huang CY (2005a) Cost-reliability-optimal release policy for software reliability models incorporating improvements in testing efficiency. J Syst Softw 77(2):139–155

    Google Scholar 

  • Huang CY (2005b) Performance analysis of software reliability growth models with testing-effort and change-point. J Syst Softw 76(2):181–194

    Google Scholar 

  • Huang CY, Lyu MR (2011) Estimation and analysis of some generalized multiple change-point software reliability models. IEEE Trans Reliab 60(2):498–514

    Google Scholar 

  • Inoue S, Yamada S (2008). Optimal software release policy with cange-point. In: IEEE international conference on industrial engineering and engineering management, 2008. IEEM 2008. (pp. 531–535). IEEE.

  • Inoue S, Yamada S (2011) Software reliability growth modeling frameworks with change of testing-environment. Int J Reliab Qual Saf Eng 18(04):365–376

    Google Scholar 

  • Inoue S, Fukuma K, Yamada S (2010) Two-dimensional change-point modeling for software reliability assessment. Int J Reliab Qual Saf Eng 17(06):531–542

    Google Scholar 

  • Inoue S, Ikeda J, Yamada S (2016) Bivariate change-point modeling for software reliability assessment with uncertainty of testing-environment factor. Ann Oper Res 244(1):209–220

    MathSciNet  MATH  Google Scholar 

  • Ji Y, Mookerjee VS, Sethi SP (2005) Optimal software development: A control theoretic approach. Inf Syst Res 16(3):292–306

    Google Scholar 

  • Jiang Z, Sarkar S, Jacob VS (2012) Post-release testing and software release policy for enterprise-level systems. Inf Syst Res 23:635–657

    Google Scholar 

  • Kapur PK, Garg RB (1991) Optimal release policies for software systems with testing effort. Int J Syst Sci 22(9):1563–1571

    Google Scholar 

  • Kapur PK, Kumar S, Garg RB (1999) Contributions to hardware and software reliability, vol 3. World Scientific.

  • Kapur PK, Kumar A, Yadav K, Khatri SK (2007) Software reliability growth modelling for errors of different severity using change point. Int J Reliab Qual Saf Eng 14(04):311–326

    Google Scholar 

  • Kapur PK, Singh VB, Anand S, Yadavalli VSS (2008) Software reliability growth model with change-point and effort control using a power function of the testing time. Int J Prod Res 46(3):771–787

    MATH  Google Scholar 

  • Kapur PK, Garg RB, Aggarwal AG, Tandon A (2009) General framework for change point problem in software reliability and related release time problem. Int J Reliab Qual Saf Eng 16(06):567–579

    Google Scholar 

  • Kapur PK, Pham H, Gupta A, Jha PC (2011) Software reliability assessment with OR applications. Springer, London

    MATH  Google Scholar 

  • Kapur PK, Pham H, Chanda U, Kumar V (2013) Optimal allocation of testing effort during testing and debugging phases: a control theoretic approach. Int J Syst Sci 44(9):1639–1650

    MathSciNet  MATH  Google Scholar 

  • Kapur PK, Khatri SK, Singh O, Shrivastava AK (2014) When to stop testing under warranty using SRGM with change-point. In: 2014 conference on IT in business, industry and government (CSIBIG) (pp. 1–7). IEEE.

  • Kapur PK, Shrivastava AK (2015) Release and testing stop time of a software: a new insight. In: 4th International conference on reliability, infocom technologies and optimization (ICRITO) (Trends and Future Directions), 2015 (pp. 1–7). IEEE

  • Kapur PK, Mishra G, Shrivastava AK (2016) A generalized framework for modelling multi up-gradations of a software with testing effort and change point. In: 2016 international conference on innovation and challenges in cyber security (ICICCS-INBUSH) (pp. 129–134). IEEE.

  • Kapur PK, Shrivastava AK, Singh O (2017) When to release and stop testing of a software. J Indian Soc Probab Stat 18(1):19–37

    Google Scholar 

  • Kapur PK, Singh O, Shrivastava AK (2018) A unified approach for optimal release, patching and testing times of a software. Int J Math Oper Res 13(4):471–491

    MathSciNet  Google Scholar 

  • Kapur PK, Panwar S, Singh O, Kumar V (2019) Joint release and testing stop time policy with testing-effort and change point. In: Risk based technologies (pp. 209–222). Springer, Singapore.

  • Khurshid S, Shrivastava AK, Iqbal J (2019) Effort based software reliability model with fault reduction factor, change point and imperfect debugging. Int J Inf Technol. https://doi.org/10.1007/s41870-019-00286-x

    Article  Google Scholar 

  • Kumar V, Singh VB, Dhamija A, Srivastav S (2018) Cost-reliability-optimal release time of software with patching considered. Int J Reliab Qual Saf Eng 25(04):1850018

    Google Scholar 

  • Li X, Xie M, Ng SH (2010) Sensitivity analysis of release time of software reliability models incorporating testing effort with multiple change-points. Appl Math Model 34(11):3560–3570

    MathSciNet  MATH  Google Scholar 

  • Majumdar R, Shrivastava AK, Kapur PK, Khatri SK (2017) Release and testing stop time of a software using multi-attribute utility theory. Life Cyc Reliab Saf Eng 6(1):47–55

    Google Scholar 

  • Minamino Y, Inoue S, Yamada S (2016) NHPP-based change-point modeling for software reliability assessment and its application to software development management. Ann Oper Res 244(1):85–101

    MathSciNet  MATH  Google Scholar 

  • Mishra G, Kapur PK, Shrivastava AK (2018) A general framework for modeling of multiple-version software with change-point. In: Quality, IT and business operations. Springer, Singapore, pp 17–32

  • Nam S, Cha JH, Cho S (2008) A Bayesian change-point analysis for software reliability models. Commun Stat Simul Comput 37(9):1855–1869

    MathSciNet  MATH  Google Scholar 

  • Okumoto K, Goel AL (1980) Optimum release time for software systems based on reliability and cost criteria. J Syst Softw 1(4):315–318

    Google Scholar 

  • Pachauri B, Kumar A, Dhar J (2013) Modeling optimal release policy under fuzzy paradigm in imperfect debugging environment. Inf Softw Technol 55(11):1974–1980

    Google Scholar 

  • Pham H (1996) A software cost model with imperfect debugging, random life cycle and penalty cost. Int J Syst Sci 27(5):455–463

    MATH  Google Scholar 

  • Pham H (2003) Software reliability and cost models: Perspectives, comparison, and practice. Eur J Oper Res 149(3):475–489

    MathSciNet  MATH  Google Scholar 

  • Pham H, Zhang X (1999) A software cost model with warranty and risk costs. IEEE Trans Comput 48(1):71–75

    Google Scholar 

  • Sehgal VK, Kapur R, Yadav K, Kumar D (2010) Software reliability growth models incorporating change point with imperfect fault removal and error generation. Int J Model Simul 30(2):196–203

    Google Scholar 

  • Shrivastava AK, Kapur PK (2018) Development of software reliability growth models with time lag and change-point and a new perspective for release time problem. Math Appl Inf Syst 2:34–52

    Google Scholar 

  • Shrivastava AK, Sachdeva N (2019) Generalized software release and testing stop time policy. Int J Qual Reliab Manage. https://doi.org/10.1108/IJQRM-07-2019-0227

    Article  Google Scholar 

  • Shyur HJ (2003) A stochastic software reliability model with imperfect-debugging and change-point. J Syst Softw 66(2):135–141

    Google Scholar 

  • Singh O, Kapur PK, Shrivastava AK, Kumar V (2015) Release time problem with multiple constraints. Int J Syst Assuran Eng Manage 6(1):83–91

    Google Scholar 

  • Singh O, Kapur PK, Shrivastava AK, Mishra G (2017) A Multi release cost model in distributed environment. Int J Reliab Qual Saf Eng 24(1):1750001

    Google Scholar 

  • Singh VB, Kapur PK, Basirzadeh M (2012) Open source software reliability growth model by considering change–point. Int J Inf Technol 4(1):405

    Google Scholar 

  • Tickoo A, Kapur PK, Shrivastava AK, Khatri SK (2016) Testing effort based modeling to determine optimal release and patching time of software. Int J Syst Assuran Eng Manage 7(4):427–434

    Google Scholar 

  • Wood A (1996) Predicting software reliability. Computer 29(11):69–77

    Google Scholar 

  • Xia G, Zeephongsekul P, Kumar S (1993) Optimal software release policy with a learning factor for imperfect debugging. Microelectron Reliab 33(1):81–86

    Google Scholar 

  • Yamada S, Osaki S (1987) Optimal software release policies with simultaneous cost and reliability requirements. Eur J Oper Res 31(1):46–51

    MathSciNet  MATH  Google Scholar 

  • Yamada S, Yamaguchi M (2016) A method of statistical process control for successful open source software projects and its application to determining the development period. Int J Reliab Qual Saf Eng 23(05):1650018

    Google Scholar 

  • Yamada S, Narihisa H, Osaki S (1984) Optimum release policies for a software system with a scheduled software delivery time. Int J Syst Sci 15(8):905–914

    MATH  Google Scholar 

  • Yamada S, Ohba M, Osaki S (1983) S-shaped reliability growth modeling for software error detection. IEEE Trans Reliab 32(5):475–484

    Google Scholar 

  • Yang B, Xie M (2000) A study of operational and testing reliability in software reliability analysis. Reliab Eng Syst Saf 70(3):323–329

    Google Scholar 

  • Zachariah B (2015) Optimal stopping time in software testing based on failure size approach. Ann Oper Res 235(1):771–784

    MathSciNet  MATH  Google Scholar 

  • Zhao J, Liu HW, Cui G, Yang XZ (2006) Software reliability growth model with change-point and environmental function. J Syst Softw 79(11):1578–1587

    Google Scholar 

  • Zhu M, Pham H (2017) A multi-release software reliability modeling for open source software incorporating dependent fault detection process. Ann Oper Res, pp 1–18.

  • Zou FZ (2003) A change-point perspective on the software failure process. Softw Test Verific Reliab 13(2):85–93

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. International Management Institute, Kolkata, West Bengal, India

    Avinash K. Shrivastava

  2. Department of Operational Research, University of Delhi, Delhi, India

    Vivek Kumar & Ompal Singh

  3. Amity Centre for Interdisciplinary Research, Amity University, Noida, UP, India

    P. K. Kapur

Authors
  1. Avinash K. Shrivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vivek Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. P. K. Kapur
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ompal Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vivek Kumar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shrivastava, A.K., Kumar, V., Kapur, P.K. et al. Software release and testing stop time decision with change point. Int J Syst Assur Eng Manag 11 (Suppl 2), 196–207 (2020). https://doi.org/10.1007/s13198-020-00988-7

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13198-020-00988-7

Keywords

Search

Navigation