Skip to main content

Approximate Probabilistic Model Checking

  • Conference paper
Verification, Model Checking, and Abstract Interpretation (VMCAI 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2937))

Abstract

Symbolic model checking methods have been extended recently to the verification of probabilistic systems. However, the representation of the transition matrix may be expensive for very large systems and may induce a prohibitive cost for the model checking algorithm. In this paper, we propose an approximation method to verify quantitative properties on discrete Markov chains. We give a randomized algorithm to approximate the probability that a property expressed by some positive LTL formula is satisfied with high confidence by a probabilistic system. Our randomized algorithm requires only a succinct representation of the system and is based on an execution sampling method. We also present an implementation and a few classical examples to demonstrate the effectiveness of our approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alur, R., Henzinger, T.A.: Reactive modules. In: Proceedings of the 11th IEEE Symposium on Logic in Computer Science, pp. 207–218 (1996)

    Google Scholar 

  2. APMC homepage, http://www.lri.fr/~syp/APMC

  3. Bianco, A., de Alfaro, L.: Model checking of probabilistic and nondeterministic systems. In: Thiagarajan, P.S. (ed.) FSTTCS 1995. LNCS, vol. 1026, pp. 499–513. Springer, Heidelberg (1995)

    Google Scholar 

  4. Biere, A., Cimatti, A., Clarke, E., Zhu, Y.: Symbolic model checking without BDD’s. In: Cleaveland, W.R. (ed.) TACAS 1999. LNCS, vol. 1579, pp. 193–207. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  5. Courcoubetis, C., Yannakakis, M.: The complexity of probabilistic verification. Journal of the ACM 42(4), 857–907 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  6. D’Argenio, P., Jeannet, B., Jensen, H., Larsen, K.: Reachability analysis of probabilistic systems by successive refinements. In: Proc. of the joint PAPM/PROBMIV (2001)

    Google Scholar 

  7. de Alfaro, L., Kwiatkowska, M., Norman, G., Parker, D., Segala, R.: Symbolic model checking of concurrent probabilistic processes using MTBDDs and the kronecker representation. In: Schwartzbach, M.I., Graf, S. (eds.) TACAS 2000. LNCS, vol. 1785, p. 395. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  8. Hartonas-Garmhausen, V., Campos, S., Clarke, E.: Probverus: Probabilistic symbolic model checking. In: Katoen, J.-P. (ed.) AMAST-ARTS 1999, ARTS 1999, and AMAST-WS 1999. LNCS, vol. 1601, p. 96. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  9. Hansson, H., Jonsson, B.: A logic for reasoning about time and reliability. Formal Aspects of Computing 6, 512–535 (1994)

    Article  MATH  Google Scholar 

  10. Hermanns, H., Katoen, J.-P., Meyer-Kayser, J., Siegle, M.: Markov chain model checker. In: Schwartzbach, M.I., Graf, S. (eds.) TACAS 2000. LNCS, vol. 1785, pp. 347–362. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  11. Hoeffding, W.: Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association 58, 13–30 (1963)

    Article  MATH  MathSciNet  Google Scholar 

  12. Jeannet, B., D’Argenio, P.R., Larsen, K.G.: RAPTURE: A tool for verifying Markov Decision Processes. In: Proc. of CONCUR 2002 (2002)

    Google Scholar 

  13. Karp, R.M., Luby, M., Madras, N.: Monte-Carlo algorithms for enumeration and reliability problems. Journal of Algorithms 10, 429–448 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  14. Kemeny, J., Snell, J., Knapp, A.: Denumerable markov chains. Springer, Heidelberg (1976)

    MATH  Google Scholar 

  15. Kwiatkowska, M., Norman, G., Parker, D.: Probabilistic symbolic model checking with PRISM: a hybrid approach. In: Katoen, J.-P., Stevens, P. (eds.) TACAS 2002. LNCS, vol. 2280, p. 52. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  16. Lassaigne, R., Peyronnet, S.: Approximate Verification of Probabilistic Systems. In: Hermanns, H., Segala, R. (eds.) PROBMIV 2002, PAPM-PROBMIV 2002, and PAPM 2002. LNCS, vol. 2399, pp. 213–214. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  17. Lovasz, L., Winkler, P.: Exact mixing time in an unknown markov chain. Electronic journal of combinatorics (1995)

    Google Scholar 

  18. Monniaux, D.: An abstract Monte-Carlo method for the analysis of probabilistic programs (extended abstract). In: 28th Symposium on Principles of Programming Languages (POPL 2001), pp. 93–101. Association for Computer Machinery (2001)

    Google Scholar 

  19. Motwani, R., Raghavan, P.: Randomized Algorithms. Cambridge University Press, Cambridge (1995)

    MATH  Google Scholar 

  20. Papadimitriou, C.H.: Computational Complexity. Addison-Wesley, Reading (1994)

    MATH  Google Scholar 

  21. Pnueli, A., Zuck, L.: Verification of multiprocess probabilistic protocols. Distributed Computing 1, 53–72 (1986)

    Article  MATH  Google Scholar 

  22. Pnueli, A., Zuck, L.: Probabilistic verification. Information and Computation 103(1), 1–29 (1993)

    Article  MATH  MathSciNet  Google Scholar 

  23. PRISM homepagem, http://www.cs.bham.ac.uk/~dxp/prism/

  24. Rabinovich, A.: Quantitative analysis of probabilistic channel systems. In: Baeten, J.C.M., Lenstra, J.K., Parrow, J., Woeginger, G.J. (eds.) ICALP 2003. LNCS, vol. 2719, Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  25. Sistla, A.P., Clarke, E.M.: The complexity of propositional linear temporal logics. Journal of the ACM 32(3), 733–749 (1985)

    Article  MATH  MathSciNet  Google Scholar 

  26. Vardi, M.Y.: Automatic verification of probabilistic concurrent finite-state programs. In: Proc. 26th Annual Symposium on Foundations of Computer Science, pp. 327–338 (1985)

    Google Scholar 

  27. Vardi, M.Y., Wolper, P.: An Automata-Theoretic Approach to Automatic Program Verification (Preliminary Report). In: Proceedings of the first IEEE Symposium on Logic in Computer Science, pp. 332–344 (1986)

    Google Scholar 

  28. Younes, H.L.S., Simmons, R.G.: Probabilistic Verication of Discrete Event Systems using Acceptance Sampling. In: Brinksma, E., Larsen, K.G. (eds.) CAV 2002. LNCS, vol. 2404, pp. 223–235. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hérault, T., Lassaigne, R., Magniette, F., Peyronnet, S. (2004). Approximate Probabilistic Model Checking. In: Steffen, B., Levi, G. (eds) Verification, Model Checking, and Abstract Interpretation. VMCAI 2004. Lecture Notes in Computer Science, vol 2937. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24622-0_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24622-0_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-20803-7

  • Online ISBN: 978-3-540-24622-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics