Skip to main content
SpringerLink
Log in

Statistical model checking: challenges and perspectives

  • Introduction
  • Published:
International Journal on Software Tools for Technology Transfer Aims and scope Submit manuscript

Abstract

Statistical model checking (SMC) is a powerful and widely used approach that consists in estimating the probability for a system to satisfy a temporal property. This is done by monitoring a finite number of executions of the system, and then extrapolating the result using statistics. The answer is correct up to some confidence that can be parameterized by the user. It is known that SMC mitigates the state-space explosion problem and allows us to handle requirements that cannot be expressed in classical temporal logics. The approach has been implemented in several toolsets, and successfully applied in a wide range of diverse areas such as systems biology, robotic, or automotive. The objectives of this special issue are (1) to survey existing results on SMC, (2) to propose SMC algorithms for a larger class of systems, and (3) to show the applicability of SMC to new emerging applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. As we shall see later, stochastic systems may deal with additional quantities such as real-time.

  2. This thesis is not concerned with the definition of efficient monitoring procedures.

References

  1. Alur, R.: Timed automata. In: Proc. 11th Int. Conference on Computer Aided Verification (CAV), Lecture Notes in Computer Science, vol. 1633, pp. 8–22. Springer, Berlin (1999)

  2. Baier, C., Haverkort, B.R., Hermanns, H., Katoen, J.-P.: Model-checking algorithms for continuous-time Markov chains. IEEE Trans. Softw. Eng. 29(6), 524–541 (2003)

    Article  Google Scholar 

  3. Baier, C., Katoen, J.-P.: Principles of Model Checking (Representation and Mind Series). The MIT Press, Cambridge (2008)

    Google Scholar 

  4. Ball, T., Millstein, T.D., Rajamani, S.K.: Polymorphic predicate abstraction. ACM Trans. Program. Lang. Syst., 27(2), 314–343 (2005)

  5. Ballarini, P.: Analyzing oscillatory trends of discrete-state stochastic processes through HASL statistical model checking. Int. J. Softw. Tools. Technol. Transf. (2015). doi:10.1007/s10009-015-0370-5

  6. Basu, A., Bensalem, S., Bozga, M., Delahaye, B., Legay, A.: Statistical abstraction and model-checking of large heterogeneous systems. Int. J. Softw. Tools Technol. Transf. 14(1), 53–72 (2012)

    Article  Google Scholar 

  7. Biere, A., Cimatti, A., Clarke, E.M., Zhu, Y.: Symbolic model checking without bdds. In: TACAS, LNCS, vol. 1579, pp. 193–207. Springer, Berlin (1999)

  8. Biondi, F., Legay, A., Malacaria, P., Wasowski, A.: Quantifying information leakage of randomized protocols. In: Proceedings of 14th International Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI’13), Rome, Italy, Lecture Notes in Computer Science, vol. 7737, pp. 68–87. Springer, Berlin (2013)

  9. Boyer, B., Corre, K., Legay, A., Sedwards, S.: Plasma-lab: a flexible, distributable statistical model checking library. In: QEST, LNCS, vol. 8054, pp. 160–164 (2013)

  10. Broy, M., Jonsson, B., Katoen, J.-P., Leucker, M., Pretschner, A. (eds.) Model-based testing of reactive systems. In: Advanced Lectures the Volume is the Outcome of a Research Seminar that was held in Schloss Dagstuhl in January 2004. Lecture Notes in Computer Science, vol. 3472. Springer, Berlin (2005)

  11. Bryant, R.: Symbolic boolean manipulation with ordered binary-decision diagrams. ACM Comput. Surv. 24(3), 293–318 (1992)

    Article  Google Scholar 

  12. Burch, J.R., Clarke, E.M., McMillan, K.L., Dill, D.L., Hwang, L.J.: Symbolic model checking: \(10^{20}\) states and beyond. Inf. Comput. 98(2), 142–170 (1992)

    Article  MathSciNet  Google Scholar 

  13. Chakraborty, S., Katoen, J.-P., Sher, F., Strelec, M.: Modelling and statistical model checking of a microgrid. Int. J. Softw. Tools. Technol. Transf. (2015). doi:10.1007/s10009-014-0345-y

  14. Ciesinski, F., Baier, C.: Liquor: A tool for qualitative and quantitative linear time analysis of reactive systems. In: Proc. of 3rd Int. Conference on the Quantitative Evaluation of Systems (QEST), pp. 131–132. IEEE (2006)

  15. Ciesinski, F., Größer, M.: On probabilistic computation tree logic. In: Validation of Stochastic Systems, LNCS, vol. 2925, pp. 147–188. Springer, Berlin (2004)

  16. Clarke, E., Grumberg, O., Peled, D.: Model Checking. MIT Press, Cambridge (1999)

    Google Scholar 

  17. Clarke, E.M., Emerson, E.A.: Design and synthesis of synchronization skeletons using branching-time temporal logic. In: Logic of Programs, Lecture Notes in Computer Science, vol. 131, pp. 52–71. Springer, Berlin (1981)

  18. Clarke, E.M., Veith, H.: Counterexamples revisited: principles, algorithms, applications. In: Verification: Theory and Practice, Essays Dedicated to Zohar Manna on the Occasion of His 64th Birthday, LNCS, vol. 2772, pp. 208–224. Springer, Berlin (2003)

  19. Classen, A., Cordy, M., Heymans, P., Legay, A., Schobbens, P.: Formal semantics, modular specification, and symbolic verification of product-line behaviour. Sci. Comput. Program. 80, 416–439 (2014)

    Article  Google Scholar 

  20. Classen, A., Cordy, M., Schobbens, P., Heymans, P., Legay, A., Raskin, J.: Featured transition systems: foundations for verifying variability-intensive systems and their application to LTL model checking. IEEE Trans. Softw. Eng. 39(8), 1069–1089 (2013)

    Article  Google Scholar 

  21. Cordy, M., Heymans, P., Legay, A., Schobbens, P., Dawagne, B., Leucker, M.: Counterexample guided abstraction refinement of product-line behavioural models. In: Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE-22), Hong Kong, China, pp. 190–201. ACM (2014)

  22. Courcoubetis, C., Yannakakis, M.: The complexity of probabilistic verification. J. ACM 42(4), 857–907 (1995)

    Article  MathSciNet  Google Scholar 

  23. D’Argenio, P., Legay, A., Sedwards, S., Traonouez, L.-M.: Smart sampling for lightweight verification of Markov decision processes. Int. J. Softw. Tools. Technol. Transf. (2015). doi:10.1007/s10009-015-0383-0

  24. David, A., Larsen, K.G., Legay, A., Mikučionis, M., Poulsen, D.B.: UPPAAL SMC tutorial. Int. J. Softw. Tools. Technol. Transf. (2015). doi:10.1007/s10009-014-0361-y

  25. David, A., Larsen, K., Legay, A., Wang, Z., Mikucionis, M.: Time for real statistical model-checking: statistical model-checking for real-time systems. In: CAV, LNCS. Springer, Berlin (2011)

  26. de Alfaro, L.L.D. da Silva, L., Faella, M., Legay, A., Roy, P., Sorea, M.: Sociable interfaces. In: Proc 5th Int. Conference on Frontiers of Combining Systems (FROCOS), Lecture Notes in Computer Science, vol. 3717, pp. 81–105. Springer, Berlin (2005)

  27. Dovier, A., Piazza, C., Policriti, A.: An efficient algorithm for computing bisimulation equivalence. J. Theor. Comput. Sci. 311(1–3), 221–256 (2004)

    Article  MathSciNet  Google Scholar 

  28. Droste, M., Gastin, P.: Weighted automata and weighted logics. Theor. Comput. Sci. 380(1–2), 69–86 (2007)

    Article  MathSciNet  Google Scholar 

  29. Ellen, C., Gerwinn, S., Fränzle, M.: Statistical model checking for stochastic hybrid systems involving nondeterminism over continuous domains. Int. J. Softw. Tools. Technol. Transf. (2014). doi:10.1007/s10009-014-0329-y

  30. Flanagan, C., Godefroid, P.: Dynamic partial-order reduction for model checking software. In: Proc. 32th Int. Symposium on Principles of Programming Languages (POPL), pp. 110–121. ACM (2005)

  31. Cabodi, G., Camurati, P., Quer, S.: Can bdds compete with sat solvers on bounded model checking? In: Proc. of 39th Design Automation Conference (DAC), pp. 117–122. ACM (2002)

  32. Hartmanns, A., Timmer, M.: Sound statistical model checking for MDP using partial order and confluence reduction. Int. J. Softw. Tools. Technol. Transf. (2014). doi:10.1007/s10009-014-0349-7

  33. Havelund, K., Rou, G.: Synthesizing monitors for safety properties. In: TACAS, LNCS, vol. 2280, pp. 342–356 (2002)

  34. Jha, S.K., Clarke, E.M., Langmead, C.J., Legay, A., Platzer, A., Zuliani, P.: A Bayesian approach to model checking biological systems. In: CMSB, pp. 218–234 (2009)

  35. Kwiatkowska, M., Norman, G., Parker, D.: PRISM 4.0: verification of probabilistic real-time systems. In: CAV’11, LNCS, vol. 6806, pp. 585–591. Springer, Berlin (2011)

  36. Kwiatkowska, M. Z., Norman, G., Parker, D.: Prism 2.0: A tool for probabilistic model checking. In: QEST, pp. 322–323. IEEE (2004)

  37. Lassaigne, R., Peyronnet, S.: Approximate planning and verification for large Markov decision processes. Int. J. Softw. Tools. Technol. Transf. (2014). doi:10.1007/s10009-014-0344-z

  38. Okamoto, M.: Some inequalities relating to the partial sum of binomial probabilities. Ann. Inst. Stat. Math. 10, 29–35 (1959)

    Article  Google Scholar 

  39. Pnueli, A.: The temporal logic of programs. In: Proc. 18th Annual Symposium on Foundations of Computer Science (FOCS), pp. 46–57 (1977)

  40. Reijsbergen, D., de Boer, P.-T., Scheinhardt, W., Haverkort, B.: On hypothesis testing for statistical model checking. Int. J. Softw. Tools. Technol. Transf. (2014). doi:10.1007/s10009-014-0350-1

  41. Roohi, N., Viswanathan, M.: Statistical model checking for unbounded until formulas. Int. J. Softw. Tools. Technol. Transf. (2015). doi:10.1007/s10009-015-0368-z

  42. Sen, K., Viswanathan, M., Agha, G.: Statistical model checking of black-box probabilistic systems. In: CAV, LNCS, vol. 3114, pp. 202–215. Springer, Berlin (2004)

  43. Wald, A.: Sequential tests of statistical hypotheses. Ann. Math. Stat. 16(2), 117–186 (1945)

    Article  MathSciNet  Google Scholar 

  44. Wolper, P., Godefroid, P.: Partial-order methods for temporal verification. In: Proc. 4th Int. Conference on Concurrency Theory (CONCUR), Lecture Notes in Computer Science, vol. 715, pp. 233–246. Springer, Berlin (1993)

  45. Younes, H.L.S.: Verification and planning for stochastic processes with asynchronous events. PhD thesis, Carnegie Mellon (2005)

  46. Younes, H.L.S.: Error control for probabilistic model checking. In: Proc. of 7th Int. Conference on Verification, Model Checking, and Abstract Interpretation (VMCAI), LNCS, vol. 3855, pp. 142–156. Springer, Berlin (2006)

  47. Younes, H.L.S., Simmons, R.G.: Probabilistic verification of discrete event systems using acceptance sampling. In: CAV, LNCS, vol. 2404, pp. 223–235. Springer, Berlin (2002)

  48. Zuliani, P.: Statistical model checking for biological applications (2014). Int. J. Softw. Tools. Technol. Transf. doi:10.1007/s10009-014-0343-0

  49. Zuliani, P., Platzer, A., Clarke, E.M.: Bayesian statistical model checking with application to simulink/stateflow verification. In: HSCC, pp. 243–252. ACM (2010)

Download references

Author information

Authors and Affiliations

  1. INRIA, Rennes, France

    Axel Legay

  2. University of Illinois at Urbana-Champaign, Champaign, USA

    Mahesh Viswanathan

Authors
  1. Axel Legay
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mahesh Viswanathan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Axel Legay.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Legay, A., Viswanathan, M. Statistical model checking: challenges and perspectives. Int J Softw Tools Technol Transfer 17, 369–376 (2015). https://doi.org/10.1007/s10009-015-0384-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10009-015-0384-z

Keywords

Search

Navigation