Abstract
We introduce a mathematical framework for black-box software testing of functional correctness, based on concepts from stochastic process theory. This framework supports the analysis of two important aspects of testing, namely: (i) coverage, probabilistic correctness and reliability modelling, and (ii) test case generation. Our model corrects some technical flaws found in previous models of probabilistic correctness found in the literature. It also provides insight into the design of new testing strategies, which can be more efficient than random testing.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
de Bakker, J.W.: Mathematical Theory of Program Correctness. Prentice-Hall, Englewood Cliffs (1980)
Barwise, J. (ed.): The Syntax and Semantics of Infinitary Languages. Lecture Notes in Mathematics, vol. 72. Springer, Heidelberg (1968)
Bauer, H.: Probability Theory and Elements of Measure Theory. Academic Press, London (1981)
Beizer, B.: Black-Box Testing. John Wiley, Chichester (1995)
Bouleau, N., Lepingle, D.: Numerical Methods for Stochastic Processes. John Wiley, New York (1994)
Budd, T.A., DeMillo, R.A., Lipton, R.J., Sayward, F.G.: Theoretical and Empirical Studies on Using Program Mutation to Test the Functional Correctness of Programs. In: 7th ACM SIGPLAN-SIGACT Symp. on Principles of Programming Languages, pp. 220–223 (1980)
Graham, R.L., Knuth, D.E., Patashnik, O.: Concrete Mathematics. Addison-Wesley, Reading (1989)
Grimmet, G., Stirzaker, D.: Probability and Random Processes. Oxford University Press, Oxford (1982)
Hamlet, R.G.: Probable Correctness Theory. Inf. Proc. Letters 25, 17–25 (1987)
Kallenberg, O.: Foundations of Modern Probability. Springer, Heidelberg (1997)
Lee, D., Yannakakis, M.: Principles and Methods of Testing Finite State Machines - a Survey. Proc. IEEE 84(8), 1090–1123 (1996)
Loeckx, J., Ehrich, H.-D., Wolf, M.: Specification of Abstract Data Types. Wiley/Teubner (1996)
Meinke, K.: Automated Black-Box Testing of Functional Correctness using Function Approximation. In: Rothermel, G. (ed.) Proc. ACM SIGSOFT Int. Symp. on Software Testing and Analysis. Software Engineering Notes, vol. 29(4), pp. 143–153. ACM Press, New York (2004)
Miller, K.W., Morell, L.J., Noonan, R.E., Park, S.K., Nicol, D.M., Murrill, B.W., Voas, J.M.: Estimating the Probability of Failure when Testing Reveals no Failures. IEEE Trans. Soft. Eng. 18(1), 33–43 (1992)
Moore, E.F.: Gedanken-experiments on Sequential Machines. Ann. Math. Studies, vol. 34, pp. 129–153. Princeton Univ. Press, Princeton (1956)
Thayer, T.A., Lipow, M., Nelson, E.C.: Software Reliability. North Holland, New York (1978)
Weiss, S.N., Weyuker, E.J.: An Extended Domain-Based Model of Software Reliability. IEEE Trans. Soft. Eng. 14(10), 1512–1524 (1988)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Meinke, K. (2006). A Stochastic Theory of Black-Box Software Testing. In: Futatsugi, K., Jouannaud, JP., Meseguer, J. (eds) Algebra, Meaning, and Computation. Lecture Notes in Computer Science, vol 4060. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11780274_30
Download citation
DOI: https://doi.org/10.1007/11780274_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35462-8
Online ISBN: 978-3-540-35464-2
eBook Packages: Computer ScienceComputer Science (R0)