Abstract
This paper looks into some aspects of using Bayesian hypothesis testing to find upper bounds for software failure probabilities, which consider prior information regarding the software component in addition to testing. The paper shows how different choices of prior probability distributions for a software component’s failure probability influence the number of tests required to obtain adequate confidence in a software component. In addition, it evaluates different choices of prior probability distributions based on their relevance in a software context. The interpretations of the different prior distributions are emphasised. As a starting point, this paper concentrates on assessment of single software components, but the proposed approach will later be extended to assess systems consisting of multiple software components. Software components include both general in-house software components, as well as pre-developed software components (e.g. COTS, SOUP, etc).
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Berger, J.O.: Statistical Decision Theory and Bayesian Analysis, 2nd edn., pp. 118–166. Springer, Heidelberg (1980), ISBN 0-387-96098-8
Cukic, B., Gunel, E., Singh, H., Guo, L.: The Theory of Software Reliability Corroboration. IEICE Trans. on Information and Systems E86-D(10), 2121–2129 (2003)
Eckhardt, D.E., Lee, L.D.: A theoretical basis for the analysis of redundant software subject to coincident errors. NASA tech. Memo, 86369 (January 1985)
Fenton, N., Krause, P., Neil, M.: Software Measurement: Uncertainty and Causal Modeling. IEEE software 19(4), 116–122 (2002)
Frankl, P., Hamlet, D., Littlewood, B., Strigini, L.: Choosing Testing Method to Deliver Reliability. In: Proc. of the 19th International Conference on Software engineering, May 1997, pp. 68–78 (1997)
Gran, B.A.: The use of Bayesian Belief Networks for combining disparate sources of information in the safety assessment of software based systems. Thesis 2002, 35, NTNU, Trondheim, Norway (2002)
Hamlet, D., Mason, D., Woit, D.: Theory of Software Reliability Based on Components. In: International Conference on Software Engineering, vol. 23, pp. 361–370 (2001)
IEC 60880-2: Software for Computers Important to Safety for Nuclear Power Plants – Part 2: Software aspects of defense against common cause failures, use of software tools and of pre-developed software (December 2000)
Krishnamurthy, S., Mathur, A.: On the Estimation of Reliability of a Software System Using Reliabilities of its Components. In: Proc. of the 8th International Symposium on Software Reliability Engineering (ISSRE) (November 1997)
Kuball, S., May, J., Hughes, G.: Building a system failure rate estimator by identifying component failure rates. In: Proc. of the 10th International Symposium on Software Reliability Engineering (ISSRE 1999), November 1999, pp. 32–41 (1999)
Littlewood, B., Miller, D.R.: Conceptual Modeling of Coincident Failures in Multiversion Software. IEEE Trans. on Software Engineering 15(12), 1596–1614 (1989)
Littlewood, B., Popov, P., Strigini, L.: Modelling software design diversity: a review. ACM Computing Surveys 33(2), 177–208 (2001)
Lyu, M.R.: Handbook of Software Reliability Engineering. IEEE Computer Society Press, Los Alamitos (1995), ISBN 0-07-039400-8
Miller, K., Morell, L.J., Noonan, R.E., Park, S.K., Nicol, D.M., Murrill, B.W., Voas, J.W.: Estimating the probability of failure when testing reveals no failures. IEEE Trans. on Software Engineering 18(1), 33–43 (1992)
Poore, J.H., Mills, H.D., Mutchler, D.: Planning and Certifying Software System Reliability. IEEE software (Janaury 1993)
Popov, P., Strigini, L., May, J., Kuball, S.: Estimating Bounds on the Reliability of Diverse Systems. IEEE trans. on Software Engineering (April 2003)
Scott, J.A., Lawrence, J.D.: Testing Existing Software for Safety-Related Applications. Lawrence Livermore National Laboratory, prepared for U.S Nuclear Regulatory Commission (1995)
Singh, H., Cortellessa, V., Cukic, B., Gunel, E., Bharadwaj, V.: A Bayesian Approach to Reliability Prediction and Assessment of Component Based Systems. In: Proc. of the 12th International Symposium on Software Reliability Engineering, ISSRE (2001)
Smidts, C., Cukic, B., Gunel, E., Li, M., Singh, H.: Software Reliability Corroboration. In: Proc. of the 27’th Annual NASA Goddard Software Engineering Workshop, SEW-27 2002 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kristiansen, M. (2005). Finding Upper Bounds for Software Failure Probabilities – Experiments and Results. In: Winther, R., Gran, B.A., Dahll, G. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2005. Lecture Notes in Computer Science, vol 3688. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11563228_14
Download citation
DOI: https://doi.org/10.1007/11563228_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29200-5
Online ISBN: 978-3-540-32000-5
eBook Packages: Computer ScienceComputer Science (R0)