skip to main content
10.1145/2856636.2856648acmotherconferencesArticle/Chapter ViewAbstractPublication PagesisecConference Proceedingsconference-collections
research-article

Software Reliability Growth Models, Tools and Data Sets-A Review

Published:18 February 2016Publication History

ABSTRACT

This paper presents effective and comprehensive review on parametric and non parametric modeling of software reliability. Reliability is one of the most important characteristic of software quality. More than hundreds of software reliability models were proposed in last few decades. These models were based on various phases of software development life cycle. Software Reliability Growth Models based on software testing were explored a lot over the years. Many authors have proposed or discussed parametric models with following characteristics such as realistic and unrealistic assumptions, limitations, applicability, environment dependability and predictability. On the other hand authors have discussed the shortcomings of parametric models and proposed non-parametric models as an alternative to address the software reliability issues. But, both the modeling techniques have their pros and cons. In this paper our aim is to give an insight of parametric and non-parametric based software reliability models. The review of real life datasets and already proposed tools for software reliability will help the beginner level researcher to continue.

References

  1. System Software Reliability by Prof. Hoang Pham Department of Industrial Engineering Rutgers the State University of New Jersey, USA.Google ScholarGoogle Scholar
  2. Pai, Ganesh J. "A survey of software reliability models." preprint: 1304.4539 (2013).Google ScholarGoogle Scholar
  3. Pham, Hoang. "Springer Series in Reliability Engineering." New Jersey, USA (2005). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Oman, Paul, and Jack Hagemeister. "Metrics for assessing a software system's maintainability." Software Maintenance, 1992. Proceerdings, Conference on. IEEE, 1992.Google ScholarGoogle Scholar
  5. Pham, Hoang. Software reliability. John Wiley & Sons, Inc., 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Littlewood, Bev, and John L. Verrall. "Likelihood function of a debugging model for computer software reliability." Reliability, IEEE Transactions on 30.2 (1981): 145--148Google ScholarGoogle ScholarCross RefCross Ref
  7. Z. Jelinski, P.B. Moranda, "Software reliability research", in Statistical Computer Performance Evaluation, ed. W. Freiberger, New York and London: Academic Press, 1972, pp 465--484.Google ScholarGoogle ScholarCross RefCross Ref
  8. Yamada, Shigeru, Mitsuru Ohba, and Shunji Osaki. "S-shaped reliability growth modeling for software error detection." Reliability, IEEE Transactions on 32.5 (1983): 475--484.Google ScholarGoogle ScholarCross RefCross Ref
  9. Tohma, Yoshihiro, et al. "Structural approach to the estimation of the number of residual software faults based on the hyper-geometric distribution." Software Engineering, IEEE Transactions on 15.3 (1989): 345--355. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Gentzler Jr, George L., and Nelson M. Andrews. "Data stability in an application of a software reliability model." Selected Areas in Communications, IEEE Journal on 8.2 (1990): 273--275. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Brocklehurst, Sarah, et al. "Recalibrating software reliability models." Software Engineering, IEEE Transactions on 16.4 (1990): 458--470. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Kanoun, Karama, Marta Rettelbusch de Bastos Martini, and Jorge Moreira De Souza. "A method for software reliability analysis and prediction application to the TROPICO-R switching system." Software Engineering, IEEE Transactions on 17.4 (1991): 334--344. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Tohma, Yoshihiro, et al. "The estimation of parameters of the hyper geometric distribution and its application to the software reliability growth model." IEEE Transactions on Software Engineering 5 (1991): 483--489. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Kapur, P. K., and R. B. Garg. "A software reliability growth model for an error-removal phenomenon." Software Engineering Journal 7.4 (1992): 291--294. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Yamada, Shigeru, Jun Hishitani, and Shunji Osaki. "Software-reliability growth with a Weibull test-effort: a model and application." Reliability, IEEE Transactions on 42.1 (1993): 100--106.Google ScholarGoogle ScholarCross RefCross Ref
  16. As H. Ascher, H. Feingold, Repairable System Reliability: Modeling, Inference, Misconceptions, and Their Causes, 1984; Marcel Dekker.Google ScholarGoogle Scholar
  17. Zeephongsekul, P., G. Xia, and S. Kumar. "Software-reliability growth model: primary-failures generate secondary-faults under imperfect debugging." Reliability, IEEE Transactions on 43.3 (1994): 408--413.Google ScholarGoogle ScholarCross RefCross Ref
  18. Tian, Jeff. "Integrating time domain and input domain analyses of software reliability using tree-based models." Software Engineering, IEEE Transactions on 21.12 (1995): 945--958. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Pasquini, A., A. N. Crespo, and P. Matrella. "Sensitivity of reliability-growth models to operational profile errors vs. testing accuracy {software testing}." Reliability, IEEE Transactions on 45.4 (1996): 531--540.Google ScholarGoogle ScholarCross RefCross Ref
  20. Hou, Rong-Huei, Sy-Yen Kuo, and Yi-Ping Chang. "Needed resources for software module test, using the hyper-geometric software reliability growth model." Reliability, IEEE Transactions on 45.4 (1996): 541--549.Google ScholarGoogle ScholarCross RefCross Ref
  21. Hou, Rong-Huei, Sy-Yen Kuo, and Yi-Ping Chang. "Optimal release policy for hyper-geometric distribution software-reliability growth model." Reliability, IEEE Transactions on 45.4 (1996): 646--651.Google ScholarGoogle ScholarCross RefCross Ref
  22. Kuo, Lynn, et al. "Bayes inference for S-shaped software-reliability growth models." Reliability, IEEE Transactions on 46.1 (1997): 76--80.Google ScholarGoogle ScholarCross RefCross Ref
  23. Tian, Jeff, and Joe Palma. "Analyzing and improving reliability: A Tree-based Approach." IEEE software 2 (1998): 97--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Chen, Mei-Hwa, Michael R. Lyu, and W. Eric Wong. "Effect of code coverage on software reliability measurement." Reliability, IEEE Transactions on 50.2 (2001): 165--170.Google ScholarGoogle ScholarCross RefCross Ref
  25. Kuo, Sy-Yen, Chin-Yu Huang, and Michael R. Lyu. "Framework for modeling software reliability, using various testing-efforts and fault-detection rates." Reliability, IEEE Transactions on 50.3 (2001): 310--320.Google ScholarGoogle ScholarCross RefCross Ref
  26. Pasquini, Alberto, Giuliano Pistolesi, and Antonio Rizzo. "Reliability analysis of systems based on software and human resources." Reliability, IEEE Transactions on 50.4 (2001): 337--345.Google ScholarGoogle ScholarCross RefCross Ref
  27. Lyu, Michael R., Sampath Rangarajan, and Aad Van Moorsel. "Optimal allocation of test resources for software reliability growth modeling in software development." Reliability, IEEE Transactions on 51.2 (2002): 183--192.Google ScholarGoogle ScholarCross RefCross Ref
  28. Teng, Xiaolin, and Hoang Pham. "A software-reliability growth model for N-version programming systems." Reliability, IEEE Transactions on 51.3 (2002): 311--321.Google ScholarGoogle ScholarCross RefCross Ref
  29. Malaiya, Yashwant K., et al. "Software reliability growth with test coverage." Reliability, IEEE Transactions on 51.4 (2002): 420--426.Google ScholarGoogle ScholarCross RefCross Ref
  30. Huang, Chin-Yu, Michael R. Lyu, and Sy-Yen Kuo. "A unified scheme of some nonhomogenous poisson process models for software reliability estimation." Software Engineering, IEEE Transactions on 29.3 (2003): 261--269. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Huang, Chin-Yu, and Chu-Ti Lin. "Software reliability analysis by considering fault dependency and debugging time lag." Reliability, IEEE Transactions on 55.3 (2006): 436--450.Google ScholarGoogle ScholarCross RefCross Ref
  32. Huang, Chin-Yu, Sy-Yen Kuo, and Michael R. Lyu. "An assessment of testing-effort dependent software reliability growth models." Reliability, IEEE Transactions on 56.2 (2007): 198--211.Google ScholarGoogle ScholarCross RefCross Ref
  33. Zachariah, Babu, and R. N. Rattihalli. "Failure size proportional models and an analysis of failure detection abilities of software testing strategies." Reliability, IEEE Transactions on 56.2 (2007): 246--253.Google ScholarGoogle ScholarCross RefCross Ref
  34. Wang, Wen-Li, Thomas L. Hemminger, and Mei-Huei Tang. "A moving average non-homogeneous Poisson process reliability growth model to account for software with repair and system structures." Reliability, IEEE Transactions on 56.3 (2007): 411--421.Google ScholarGoogle ScholarCross RefCross Ref
  35. Huang, Chin-Yu, and Wei-Chih Huang. "Software reliability analysis and measurement using finite and infinite server queueing models." Reliability, IEEE Transactions on 57.1 (2008): 192--203.Google ScholarGoogle ScholarCross RefCross Ref
  36. Schneidewind, Norman. "Comparison of reliability and testing models." Reliability, IEEE Transactions on 57.4 (2008): 607--615.Google ScholarGoogle ScholarCross RefCross Ref
  37. Sharma, Kapil, et al. "Selection of optimal software reliability growth models using a distance based approach." Reliability, IEEE Transactions on 59.2 (2010): 266--276.Google ScholarGoogle ScholarCross RefCross Ref
  38. Huang, Chin-Yu, and Michael R. Lyu. "Estimation and analysis of some generalized multiple change-point software reliability models." Reliability, IEEE Transactions on 60.2 (2011): 498--514.Google ScholarGoogle ScholarCross RefCross Ref
  39. Kapur, P. K., et al. "Two dimensional multi-release software reliability modeling and optimal release planning." Reliability, IEEE Transactions on 61.3 (2012): 758--768.Google ScholarGoogle ScholarCross RefCross Ref
  40. Yan, He. "NHPP software reliability growth model incorporating fault detection and debugging." Software Engineering and Service Science (ICSESS), 2013 4th IEEE International Conference on. IEEE, 2013.Google ScholarGoogle Scholar
  41. Washizaki, Hironori, Kiyoshi Honda, and Yoshiaki Fukazawa. "Predicting Release Time for Open Source Software based on the Generalized Software Reliability Model."Google ScholarGoogle Scholar
  42. Wayne, Martin, and Mohammad Modarres. "A Bayesian Model for Complex System Reliability Growth under Arbitrary Corrective Actions." Reliability, IEEE Transactions on 64.1 (2015): 206--220.Google ScholarGoogle ScholarCross RefCross Ref
  43. Sofer, Ariela, and Douglas R. Miller. "A nonparametric software-reliability growth model." Reliability, IEEE Transactions on 40.3 (1991): 329--337.Google ScholarGoogle ScholarCross RefCross Ref
  44. Karunanithi, Nachimuthu, Darrell Whitley, and Yashwant K. Malaiya. "Prediction of software reliability using connectionist models." Software Engineering, IEEE Transactions on 18.7 (1992): 563--574. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Sitte, Renate. "Comparison of software-reliability-growth predictions: neural networks vs parametric-recalibration." Reliability, IEEE Transactions on 48.3 (1999): 285--291.Google ScholarGoogle ScholarCross RefCross Ref
  46. Cai, Kai-Yuan, et al. "On the neural network approach in software reliability modeling." Journal of Systems and Software 58.1 (2001): 47--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Costa, Eduardo Oliveira, et al. "Exploring genetic programming and boosting techniques to model software reliability." Reliability, IEEE Transactions on 56.3 (2007): 422--434.Google ScholarGoogle ScholarCross RefCross Ref
  48. Wang, Zhiguo, Jinde Wang, and Xue Liang. "Nonparametric estimation for NHPP software reliability models." Journal of Applied Statistics 34.1 (2007): 107--119.Google ScholarGoogle ScholarCross RefCross Ref
  49. Wilson, Simon P., and Francisco J. Samaniego. "Nonparametric analysis of the order-statistic model in software reliability." Software Engineering, IEEE Transactions on 33.3 (2007): 198--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Zhang, Yongqiang, and Huifang Cheng. "Improved Genetic Programming Algorithm Applied to Symbolic Regression and Software Reliability Modeling." Journal of Software Engineering and Applications 2.05 (2009): 354.Google ScholarGoogle ScholarCross RefCross Ref
  51. Ayyoub, Belal, and Asim El-Sheikh. "A Model for System Reliability Optimization Problems Based on Ant colony Using Index of Criticality Constrain." ICIT 2009 Conference-Bioinformatics and Image Volume: Bioinformatics and Image. 2009.Google ScholarGoogle Scholar
  52. Jin, C. "Software reliability prediction based on support vector regression using a hybrid genetic algorithm and simulated annealing algorithm." IET software 5.4 (2011): 398--405.Google ScholarGoogle ScholarCross RefCross Ref
  53. Lo, Jung-Hua. "A study of applying ARIMA and SVM model to software reliability prediction." Uncertainty Reasoning and Knowledge Engineering (URKE), 2011 International Conference on. Vol. 1. IEEE, 2011.Google ScholarGoogle Scholar
  54. LI, JUNG-SHIAN, and MING-WANG GUO. "A Non-Parametric Software Reliability Modeling Approach by Using Gene Expression Programming " Journal of Information Science and Engineering 21 (2005): 1201--1211.Google ScholarGoogle Scholar
  55. Wason, Ritika, P. Ahmed, and M. Qasim Rafiq. "Automata-Based Software Reliability Model: The Key to Reliable Software." International Journal of Software Engineering and Its Applications 7.6 (2013): 111--126.Google ScholarGoogle ScholarCross RefCross Ref
  56. N. Kiran, V. Ravi, Software reliability prediction using wavelet neural networks, in: iccima, IEEE Computer Society, 2007, pp. 195--199. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. S. Zaidi, S. Danial, B. Usmani, Modeling inter-failure time series using neural networks, in: IEEE International Multitopic Conference, 2008, pp. 409--411.Google ScholarGoogle ScholarCross RefCross Ref
  58. J. Lo, The implementation of artificial neural networks applying to software reliability modeling, in: Proceedings of the 21st annual international conference on Chinese control and decision, IEEE Press, 2009, pp. 4385--4390. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. B. Yang, X. Li, M. Xie, F. Tan, A generic data-driven software reliability model with model mining technique, Reliability Engineering & System Safety 95 (6) (2010) 671--678.Google ScholarGoogle ScholarCross RefCross Ref
  60. Arjestan, Mina Ebrahimi, and Seyed Hamidreza Pasandideh. "Applying Meta-heuristic in a multi-objective reliability problem with weight and space constraints." (2013).Google ScholarGoogle Scholar
  61. Lyu, Michael R., and Allen Nikora. "CASRE: a computer-aided software reliability estimation tool." Computer-Aided Software Engineering, 1992. Proceedings., Fifth International Workshop on. IEEE, 1992.Google ScholarGoogle Scholar
  62. Kanoun, Karama, et al. "SoRel: a tool for reliability growth analysis and prediction from statistical failure data." Fault-Tolerant Computing, 1993. FTCS-23. Digest of Papers., The Twenty-Third International Symposium on. IEEE, 1993.Google ScholarGoogle Scholar
  1. Software Reliability Growth Models, Tools and Data Sets-A Review

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            ISEC '16: Proceedings of the 9th India Software Engineering Conference
            February 2016
            204 pages
            ISBN:9781450340182
            DOI:10.1145/2856636

            Copyright © 2016 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 18 February 2016

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

            Acceptance Rates

            ISEC '16 Paper Acceptance Rate25of127submissions,20%Overall Acceptance Rate76of315submissions,24%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader