ABSTRACT
This paper presents effective and comprehensive review on parametric and non parametric modeling of software reliability. Reliability is one of the most important characteristic of software quality. More than hundreds of software reliability models were proposed in last few decades. These models were based on various phases of software development life cycle. Software Reliability Growth Models based on software testing were explored a lot over the years. Many authors have proposed or discussed parametric models with following characteristics such as realistic and unrealistic assumptions, limitations, applicability, environment dependability and predictability. On the other hand authors have discussed the shortcomings of parametric models and proposed non-parametric models as an alternative to address the software reliability issues. But, both the modeling techniques have their pros and cons. In this paper our aim is to give an insight of parametric and non-parametric based software reliability models. The review of real life datasets and already proposed tools for software reliability will help the beginner level researcher to continue.
- System Software Reliability by Prof. Hoang Pham Department of Industrial Engineering Rutgers the State University of New Jersey, USA.Google Scholar
- Pai, Ganesh J. "A survey of software reliability models." preprint: 1304.4539 (2013).Google Scholar
- Pham, Hoang. "Springer Series in Reliability Engineering." New Jersey, USA (2005). Google ScholarDigital Library
- Oman, Paul, and Jack Hagemeister. "Metrics for assessing a software system's maintainability." Software Maintenance, 1992. Proceerdings, Conference on. IEEE, 1992.Google Scholar
- Pham, Hoang. Software reliability. John Wiley & Sons, Inc., 1999. Google ScholarDigital Library
- Littlewood, Bev, and John L. Verrall. "Likelihood function of a debugging model for computer software reliability." Reliability, IEEE Transactions on 30.2 (1981): 145--148Google ScholarCross Ref
- Z. Jelinski, P.B. Moranda, "Software reliability research", in Statistical Computer Performance Evaluation, ed. W. Freiberger, New York and London: Academic Press, 1972, pp 465--484.Google ScholarCross Ref
- Yamada, Shigeru, Mitsuru Ohba, and Shunji Osaki. "S-shaped reliability growth modeling for software error detection." Reliability, IEEE Transactions on 32.5 (1983): 475--484.Google ScholarCross Ref
- Tohma, Yoshihiro, et al. "Structural approach to the estimation of the number of residual software faults based on the hyper-geometric distribution." Software Engineering, IEEE Transactions on 15.3 (1989): 345--355. Google ScholarDigital Library
- Gentzler Jr, George L., and Nelson M. Andrews. "Data stability in an application of a software reliability model." Selected Areas in Communications, IEEE Journal on 8.2 (1990): 273--275. Google ScholarDigital Library
- Brocklehurst, Sarah, et al. "Recalibrating software reliability models." Software Engineering, IEEE Transactions on 16.4 (1990): 458--470. Google ScholarDigital Library
- Kanoun, Karama, Marta Rettelbusch de Bastos Martini, and Jorge Moreira De Souza. "A method for software reliability analysis and prediction application to the TROPICO-R switching system." Software Engineering, IEEE Transactions on 17.4 (1991): 334--344. Google ScholarDigital Library
- Tohma, Yoshihiro, et al. "The estimation of parameters of the hyper geometric distribution and its application to the software reliability growth model." IEEE Transactions on Software Engineering 5 (1991): 483--489. Google ScholarDigital Library
- Kapur, P. K., and R. B. Garg. "A software reliability growth model for an error-removal phenomenon." Software Engineering Journal 7.4 (1992): 291--294. Google ScholarDigital Library
- Yamada, Shigeru, Jun Hishitani, and Shunji Osaki. "Software-reliability growth with a Weibull test-effort: a model and application." Reliability, IEEE Transactions on 42.1 (1993): 100--106.Google ScholarCross Ref
- As H. Ascher, H. Feingold, Repairable System Reliability: Modeling, Inference, Misconceptions, and Their Causes, 1984; Marcel Dekker.Google Scholar
- Zeephongsekul, P., G. Xia, and S. Kumar. "Software-reliability growth model: primary-failures generate secondary-faults under imperfect debugging." Reliability, IEEE Transactions on 43.3 (1994): 408--413.Google ScholarCross Ref
- Tian, Jeff. "Integrating time domain and input domain analyses of software reliability using tree-based models." Software Engineering, IEEE Transactions on 21.12 (1995): 945--958. Google ScholarDigital Library
- Pasquini, A., A. N. Crespo, and P. Matrella. "Sensitivity of reliability-growth models to operational profile errors vs. testing accuracy {software testing}." Reliability, IEEE Transactions on 45.4 (1996): 531--540.Google ScholarCross Ref
- Hou, Rong-Huei, Sy-Yen Kuo, and Yi-Ping Chang. "Needed resources for software module test, using the hyper-geometric software reliability growth model." Reliability, IEEE Transactions on 45.4 (1996): 541--549.Google ScholarCross Ref
- Hou, Rong-Huei, Sy-Yen Kuo, and Yi-Ping Chang. "Optimal release policy for hyper-geometric distribution software-reliability growth model." Reliability, IEEE Transactions on 45.4 (1996): 646--651.Google ScholarCross Ref
- Kuo, Lynn, et al. "Bayes inference for S-shaped software-reliability growth models." Reliability, IEEE Transactions on 46.1 (1997): 76--80.Google ScholarCross Ref
- Tian, Jeff, and Joe Palma. "Analyzing and improving reliability: A Tree-based Approach." IEEE software 2 (1998): 97--104. Google ScholarDigital Library
- Chen, Mei-Hwa, Michael R. Lyu, and W. Eric Wong. "Effect of code coverage on software reliability measurement." Reliability, IEEE Transactions on 50.2 (2001): 165--170.Google ScholarCross Ref
- Kuo, Sy-Yen, Chin-Yu Huang, and Michael R. Lyu. "Framework for modeling software reliability, using various testing-efforts and fault-detection rates." Reliability, IEEE Transactions on 50.3 (2001): 310--320.Google ScholarCross Ref
- Pasquini, Alberto, Giuliano Pistolesi, and Antonio Rizzo. "Reliability analysis of systems based on software and human resources." Reliability, IEEE Transactions on 50.4 (2001): 337--345.Google ScholarCross Ref
- Lyu, Michael R., Sampath Rangarajan, and Aad Van Moorsel. "Optimal allocation of test resources for software reliability growth modeling in software development." Reliability, IEEE Transactions on 51.2 (2002): 183--192.Google ScholarCross Ref
- Teng, Xiaolin, and Hoang Pham. "A software-reliability growth model for N-version programming systems." Reliability, IEEE Transactions on 51.3 (2002): 311--321.Google ScholarCross Ref
- Malaiya, Yashwant K., et al. "Software reliability growth with test coverage." Reliability, IEEE Transactions on 51.4 (2002): 420--426.Google ScholarCross Ref
- Huang, Chin-Yu, Michael R. Lyu, and Sy-Yen Kuo. "A unified scheme of some nonhomogenous poisson process models for software reliability estimation." Software Engineering, IEEE Transactions on 29.3 (2003): 261--269. Google ScholarDigital Library
- Huang, Chin-Yu, and Chu-Ti Lin. "Software reliability analysis by considering fault dependency and debugging time lag." Reliability, IEEE Transactions on 55.3 (2006): 436--450.Google ScholarCross Ref
- Huang, Chin-Yu, Sy-Yen Kuo, and Michael R. Lyu. "An assessment of testing-effort dependent software reliability growth models." Reliability, IEEE Transactions on 56.2 (2007): 198--211.Google ScholarCross Ref
- Zachariah, Babu, and R. N. Rattihalli. "Failure size proportional models and an analysis of failure detection abilities of software testing strategies." Reliability, IEEE Transactions on 56.2 (2007): 246--253.Google ScholarCross Ref
- Wang, Wen-Li, Thomas L. Hemminger, and Mei-Huei Tang. "A moving average non-homogeneous Poisson process reliability growth model to account for software with repair and system structures." Reliability, IEEE Transactions on 56.3 (2007): 411--421.Google ScholarCross Ref
- Huang, Chin-Yu, and Wei-Chih Huang. "Software reliability analysis and measurement using finite and infinite server queueing models." Reliability, IEEE Transactions on 57.1 (2008): 192--203.Google ScholarCross Ref
- Schneidewind, Norman. "Comparison of reliability and testing models." Reliability, IEEE Transactions on 57.4 (2008): 607--615.Google ScholarCross Ref
- Sharma, Kapil, et al. "Selection of optimal software reliability growth models using a distance based approach." Reliability, IEEE Transactions on 59.2 (2010): 266--276.Google ScholarCross Ref
- Huang, Chin-Yu, and Michael R. Lyu. "Estimation and analysis of some generalized multiple change-point software reliability models." Reliability, IEEE Transactions on 60.2 (2011): 498--514.Google ScholarCross Ref
- Kapur, P. K., et al. "Two dimensional multi-release software reliability modeling and optimal release planning." Reliability, IEEE Transactions on 61.3 (2012): 758--768.Google ScholarCross Ref
- Yan, He. "NHPP software reliability growth model incorporating fault detection and debugging." Software Engineering and Service Science (ICSESS), 2013 4th IEEE International Conference on. IEEE, 2013.Google Scholar
- Washizaki, Hironori, Kiyoshi Honda, and Yoshiaki Fukazawa. "Predicting Release Time for Open Source Software based on the Generalized Software Reliability Model."Google Scholar
- Wayne, Martin, and Mohammad Modarres. "A Bayesian Model for Complex System Reliability Growth under Arbitrary Corrective Actions." Reliability, IEEE Transactions on 64.1 (2015): 206--220.Google ScholarCross Ref
- Sofer, Ariela, and Douglas R. Miller. "A nonparametric software-reliability growth model." Reliability, IEEE Transactions on 40.3 (1991): 329--337.Google ScholarCross Ref
- Karunanithi, Nachimuthu, Darrell Whitley, and Yashwant K. Malaiya. "Prediction of software reliability using connectionist models." Software Engineering, IEEE Transactions on 18.7 (1992): 563--574. Google ScholarDigital Library
- Sitte, Renate. "Comparison of software-reliability-growth predictions: neural networks vs parametric-recalibration." Reliability, IEEE Transactions on 48.3 (1999): 285--291.Google ScholarCross Ref
- Cai, Kai-Yuan, et al. "On the neural network approach in software reliability modeling." Journal of Systems and Software 58.1 (2001): 47--62. Google ScholarDigital Library
- Costa, Eduardo Oliveira, et al. "Exploring genetic programming and boosting techniques to model software reliability." Reliability, IEEE Transactions on 56.3 (2007): 422--434.Google ScholarCross Ref
- Wang, Zhiguo, Jinde Wang, and Xue Liang. "Nonparametric estimation for NHPP software reliability models." Journal of Applied Statistics 34.1 (2007): 107--119.Google ScholarCross Ref
- Wilson, Simon P., and Francisco J. Samaniego. "Nonparametric analysis of the order-statistic model in software reliability." Software Engineering, IEEE Transactions on 33.3 (2007): 198--208. Google ScholarDigital Library
- Zhang, Yongqiang, and Huifang Cheng. "Improved Genetic Programming Algorithm Applied to Symbolic Regression and Software Reliability Modeling." Journal of Software Engineering and Applications 2.05 (2009): 354.Google ScholarCross Ref
- Ayyoub, Belal, and Asim El-Sheikh. "A Model for System Reliability Optimization Problems Based on Ant colony Using Index of Criticality Constrain." ICIT 2009 Conference-Bioinformatics and Image Volume: Bioinformatics and Image. 2009.Google Scholar
- Jin, C. "Software reliability prediction based on support vector regression using a hybrid genetic algorithm and simulated annealing algorithm." IET software 5.4 (2011): 398--405.Google ScholarCross Ref
- Lo, Jung-Hua. "A study of applying ARIMA and SVM model to software reliability prediction." Uncertainty Reasoning and Knowledge Engineering (URKE), 2011 International Conference on. Vol. 1. IEEE, 2011.Google Scholar
- LI, JUNG-SHIAN, and MING-WANG GUO. "A Non-Parametric Software Reliability Modeling Approach by Using Gene Expression Programming " Journal of Information Science and Engineering 21 (2005): 1201--1211.Google Scholar
- Wason, Ritika, P. Ahmed, and M. Qasim Rafiq. "Automata-Based Software Reliability Model: The Key to Reliable Software." International Journal of Software Engineering and Its Applications 7.6 (2013): 111--126.Google ScholarCross Ref
- N. Kiran, V. Ravi, Software reliability prediction using wavelet neural networks, in: iccima, IEEE Computer Society, 2007, pp. 195--199. Google ScholarDigital Library
- S. Zaidi, S. Danial, B. Usmani, Modeling inter-failure time series using neural networks, in: IEEE International Multitopic Conference, 2008, pp. 409--411.Google ScholarCross Ref
- J. Lo, The implementation of artificial neural networks applying to software reliability modeling, in: Proceedings of the 21st annual international conference on Chinese control and decision, IEEE Press, 2009, pp. 4385--4390. Google ScholarDigital Library
- B. Yang, X. Li, M. Xie, F. Tan, A generic data-driven software reliability model with model mining technique, Reliability Engineering & System Safety 95 (6) (2010) 671--678.Google ScholarCross Ref
- Arjestan, Mina Ebrahimi, and Seyed Hamidreza Pasandideh. "Applying Meta-heuristic in a multi-objective reliability problem with weight and space constraints." (2013).Google Scholar
- Lyu, Michael R., and Allen Nikora. "CASRE: a computer-aided software reliability estimation tool." Computer-Aided Software Engineering, 1992. Proceedings., Fifth International Workshop on. IEEE, 1992.Google Scholar
- Kanoun, Karama, et al. "SoRel: a tool for reliability growth analysis and prediction from statistical failure data." Fault-Tolerant Computing, 1993. FTCS-23. Digest of Papers., The Twenty-Third International Symposium on. IEEE, 1993.Google Scholar
- Software Reliability Growth Models, Tools and Data Sets-A Review
Recommendations
A Hybrid Technique for Software Reliability Prediction
ISEC '15: Proceedings of the 8th India Software Engineering ConferenceReliability is an important factor of software quality. The accurate prediction of software reliability is a challenging task. There exist many reliability models to predict the reliability based on software testing activities. There are many software ...
An Empirical Study of Reliability Growth of Open versus Closed Source Software through Software Reliability Growth Models
APSEC '12: Proceedings of the 2012 19th Asia-Pacific Software Engineering Conference - Volume 01The purpose of this study is to analyze the reliability growth of Open Source Software (OSS) versus software developed in-house (i.e. Closed Source Software, CSS) using Software Reliability Growth Model. This study uses 22 datasets containing failure ...
Software Reliability Growth Modeling: Models and Applications
This paper summarizes existing software reliability growth models (SRGM's) described by nonhomogeneous Poisson processes. The SRGM's are classified in terms of the software reliability growth index of the error detection rate per error. The maximum-...
Comments