Skip to main content
Log in

Stochastic software testing

  • Published:
Annals of Software Engineering

Abstract

This paper presents a method for test case selection that allows a formal approach to testing software. The two main ideas are (1) that testers create stochastic models of software behavior instead of crafting individual test cases and (2) that specific test cases are generated from the stochastic models and applied to the software under test. This paper describes a method for creating a stochastic model in the context of a solved example. We concentrate on Markov models and show how non‐Markovian behavior can be embedded in such models without violating the Markov property.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Avritzer, A. and E. Weyuker (1995), “Automatic Generation of Load Test Suites and the Assessment of the Resulting Software,” IEEE Transactions on Software Engineering 21,9, 705–716.

    Article  Google Scholar 

  • Dahle, O. (1995), “Statistical Usage Testing Applied to Mobile Telecommunication Systems,” MS Thesis, Department of Computer Science, University of Trondheim, Trondheim, Norway.

  • Duran, J. and S. Ntafos (1984), “An Evaluation of Random Testing,” IEEE Transactions on Software Engineering 10,4, 438–444.

    Google Scholar 

  • Duran, J. and J. Wiorkowski (1984), “Quantifying Software Validity by Sampling,” IEEE Transactions on Reliability 29,2, 141–144.

    Article  Google Scholar 

  • Feller, W. (1950), An Introduction to Probability Theory and its Application, Volume 1, Wiley, New York, NY.

    Google Scholar 

  • Hamlet, D. and R. Taylor (1990), “Partition Testing Does Not Inspire Confidence,” IEEE Transactions on Software Engineering 16,12, 1402–1411.

    Article  MathSciNet  Google Scholar 

  • Houghtaling, M. (1996), “Automation Frameworks for Markov Chain Statistical Testing,” In Proceedings of the Automated Software Test and Evaluation Conference, EFPDMA Press, Washington, DC.

    Google Scholar 

  • Ostrand, T. and M. Balcer (1988), “The Category-Partition Method for Specifying and Generating Functional Tests,” Communications of the ACM 31,6, 676–686.

    Article  Google Scholar 

  • Poore, J.H., H.D. Mills, and D.M. Mutchler (1993), “Planning and Certifying Software System Reliability,” IEEE Software 10,1, 88–99.

    Article  Google Scholar 

  • Rautakorpi, M. (1995), “Application of Markov Chain Techniques in Certification of Software,” MS Thesis, Department of Mathematics and Systems Analysis, Helsinki University of Technology, Helsinki, Finland.

  • Thevenod-Fosse, P. and H. Waeselynck (1993), “STATEMATE Applied to Statistical Software Testing,” In Proceedings of the International Symposium on Software Testing and Analysis, ACM Press, Cambridge, MA, pp. 99–109.

    Google Scholar 

  • Whittaker, J. and M. Thomason (1994), “A Markov Chain Model for Statistical Software Testing,” IEEE Transactions on Software Engineering 20,10, 812–824.

    Article  Google Scholar 

  • Whittaker, J.A. (1992), “Markov Chain Techniques for Software Testing and Reliability Analysis,” PhD Dissertation, Department of Computer Science, University of Tennessee, Knoxville, TN.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Whittaker, J.A. Stochastic software testing. Annals of Software Engineering 4, 115–131 (1997). https://doi.org/10.1023/A:1018975029705

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1018975029705

Keywords

Navigation