research-article

A two-phase approximation for model checking probabilistic unbounded until properties of probabilistic systems

Authors:

Samik BasuAuthors Info & Claims

ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 21, Issue 3

Article No.: 18, Pages 1 - 35

https://doi.org/10.1145/2211616.2211621

Published: 03 July 2012 Publication History

Abstract

We have developed a new approximate probabilistic model-checking method for untimed properties in probabilistic systems, expressed in a probabilistic temporal logic (PCTL, CSL). This method, in contrast to the existing ones, does not require the untimed until properties to be bounded a priori, where the bound refers to the number of discrete steps in the system required to verify the until property. The method consists of two phases. In the first phase, a suitable system- and property-dependent bound k₀ is obtained automatically. In the second phase, the probability of satisfying the k₀-bounded until property is computed as the estimate of the probability of satisfying the original unbounded until property. Both phases require only verification of bounded until properties, which can be effectively performed by simulation-based methods. We prove the correctness of the proposed two-phase method and present its optimized implementation in the widely used PRISM model-checking engine. We compare this implementation with sampling-based model-checking techniques implemented in two tools: PRISM and MRMC. We show that for several models these existing tools fail to compute the result, while the two-phase method successfully computes the result efficiently with respect to time and space.

References

[1]

Aziz, A., Sanwal, K., Singhal, V., and Brayton, R. 1996. Verifying continuous time Markov chains. In Proceedings of the International Conference on Computer Aided Verification. 269--276.

Digital Library

[2]

Aziz, A., Sanwal, K., Singhal, V., and Brayton, R. 2000. Model checking continuous time Markov chains. ACM Trans. Computat. Logic 1, 1, 162--170.

Digital Library

[3]

Baier, C., Haverkort, B., Hermanns, H., and Katoen, J.-P. 2003. Model-checking algorithms for continuous-time markov chains. IEEE Trans. Softw. Eng. 29, 6, 524--541.

Digital Library

[4]

Bianco, A. and de Alfaro, L. 1995. Model checking of probabilistic and nondeterministic systems. In Proceedings of the Conference on Foundations of Software Technology and Theoretical Computer Science.

Digital Library

[5]

Courcoubetis, C. and Yannakakis, M. 1995. The complexity of probabilistic verification. J. ACM 42, 4, 857--907.

Digital Library

[6]

Duflot, M., Kwiatkowska, M., Norman, G., and Parker, D. 2006. A formal analysis of Bluetooth device discovery. Int. J. Softw. Tools Technol. Transfer 8, 621--632.

Digital Library

[7]

Grosu, R. and Smolka, S. A. 2005. Monte Carlo model checking. In Proceedings of the International Conference on Tools and Algorithms for the Contruction and Analysis of Systems. 271--286.

Digital Library

[8]

Grunske, L. 2008. Specification patterns for probabilistic quality properties. In Proceedings of the International Conference on Software Engineering. 31--40.

Digital Library

[9]

Hansson, H. and Jonsson, B. 1994. A logic for reasoning about time and reliability. Formal Aspects Comput. 6, 5, 512--535.

Digital Library

[10]

He, R., Jennings, P., Basu, S., Ghosh, A., and Wu, H. 2010. A bounded statistical approach for model checking of unbounded until properties. In Proceedings of the International Conference on Automated Software Engineering. 225--234.

Digital Library

[11]

Herault, T., Lassaigne, R., Magniette, F., and Peyronnet, S. 2004. Approximate probabilistic model checking. In Proceedings of the 5th International Conference on Verification, Model Checking, and Abstract Interpretation.

[12]

Hinton, A., Kwiatkowska, M., Norman, G., and Parker, D. 2006. PRISM: A tool for automatic verification of probabilistic systems. In Proceedings of the 12th International Conference on Tools and Algorithms for the Construction and Analysis of Systems.

Digital Library

[13]

Hoeffding, W. 1963. Probability inequalities for sums of bounded random variables. J. Amer. Stat. Assoc. 58, 301, 13--30.

[14]

Jansen, D. N., Katoen, J.-P., Oldenkamp, M., Stoelinga, M., and Zapreev, I. 2007. How fast and fat is your probabilistic model checker. In Proceedings of the Haifa Verification Coference. 69--85.

Digital Library

[15]

Jennings, P., Basu, S., and Ghosh, A. 2010. Two-phase PMCK. http://www.cs.iastate.edu/&sim;poj/prism-u2b.

[16]

Katoen, J.-P. and Zapreev, I. 2009. Simulation-based CTMC model checking. In Proceedings of the International Conference on the Quantitative Evaluation of Systems. IEEE Computer Society Press, Los Alamitos, CA.

Digital Library

[17]

Kwiatkowska, M., Norman, G., and Parker, D. 2007. Stochastic model checking. In Formal Methods for the Design of Computer, Communication and Software Systems: Performance Evaluation, M. Bernardo and J. Hillston, Eds. Lecture Notes in Computer Science (Tutorial Volume), vol. 4486. Springer, Berlin, 220--270.

Digital Library

[18]

Kwiatkowska, M., Norman, G., and Parker, D. 2008. Using probabilistic model checking in systems biology. ACM SIGMETRICS Perform. Eval. Rev. 35, 14--21.

Digital Library

[19]

Legay, A., Delahaye, B., and Bensalem, S. 2010. Statistical model checking: An overview. In Proceedings of the International Conference on Runtime Verification. H. Barringer, Y. Falcone, B. Finkbeiner, K. Havelund, I. Lee, G. J. Pace, G. Rosu, O. Sokolsky, and N. Tillmann, Eds. Lecture Notes in Computer Science, vol. 6418. Springer, Berlin, 122--135.

Digital Library

[20]

Massart, P. 1990. The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Ann. Probab. 18, 1269--1283.

[21]

MRMC 2010. Markov reward model checker. http://www.mrmc-tool.org/trac.

[22]

Norman, G. and Shmatikov, V. 2006. Analysis of probabilistic contract signing. J. Comput. Secur. 14, 561--589.

Digital Library

[23]

Rabih, D. and Pekergin, N. 2009. Statistical model checking using perfect simulation. In Proceedings of the International Symposium on Automated Technology for Verification and Analysis. 120--134.

Digital Library

[24]

Reiter, M. K. and Rabin, A. D. 1998. Crowds: Anonymity for web transactions. ACM Trans. Inform. Syst. Secur. 1, 1, 66--92.

Digital Library

[25]

Roy, A. and Gopinath, K. 2005. Improved probabilistic models for 802.11 protocol verification. In Proceedings of the 14th International Conference on Computer Aided Verification.

Digital Library

[26]

Sen, K., Viswanathan, M., and Agha, G. 2005. On statistical model checking of stochastic systems. In Proceedings of the 4th International Conference on Computer Aided Verification.

Digital Library

[27]

Wald, A. 1945. Sequential tests of statistical hypotheses. Ann. Math. Stat. 16, 2, 117--186.

[28]

Younes, H. L., Kwiatkowska, M., Norman, G., and Parker, D. 2006. Numerical vs. statistical probabilistic model checking. Int. J. Softw. Tools Technol. Transfer 8, 3, 216--228.

Digital Library

[29]

Younes, H. L. S. 2005. Ymer: A statistical model checker. In Proceedings of the International Conference on Computer Aided Verification.

Digital Library

[30]

Younes, H. L. S. and Simmons, R. G. 2002. Probabilistic verification of discrete event systems using acceptance sampling. In Proceedings of the 14th International Conference on Computer Aided Verification.

Digital Library

[31]

Younes, H. L. S. and Simmons, R. G. 2006. Statistical probabilistic model checking with a focus on time-bounded properties. Inform. Comput. 204, 9, 1368--1409.

Digital Library

[32]

Zapreev, I. S. 2008. Model checking Markov chains: Techniques and tools. Ph.D. dissertation, University of Twente, The Netherlands.

Cited By

Su GRosenblum DTamburrelli GDillon LVisser WWilliams L(2016)Reliability of Run-Time Quality-of-Service evaluation using parametric model checkingProceedings of the 38th International Conference on Software Engineering10.1145/2884781.2884814(73-84)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2884781.2884814
Basu ABensalem SBozga MDelahaye BLegay A(2011)Statistical abstraction and model-checking of large heterogeneous systemsInternational Journal on Software Tools for Technology Transfer10.1007/s10009-011-0201-214:1(53-72)Online publication date: 21-May-2011
https://doi.org/10.1007/s10009-011-0201-2

Index Terms

A two-phase approximation for model checking probabilistic unbounded until properties of probabilistic systems

Recommendations

The ins and outs of the probabilistic model checker MRMC

The Markov Reward Model Checker (MRMC) is a software tool for verifying properties over probabilistic models. It supports PCTL and CSL model checking, and their reward extensions. Distinguishing features of MRMC are its support for computing time- and ...
Model checking epistemic-probabilistic logic using probabilistic interpreted systems

Model checking is a formal technique widely used to verify security and communication protocols in epistemic multi-agent systems against given properties. Qualitative properties such as safety and liveliness have been widely analyzed in the literature. ...
A bounded statistical approach for model checking of unbounded until properties
ASE '10: Proceedings of the 25th IEEE/ACM International Conference on Automated Software Engineering

We study the problem of statistical model checking of probabilistic systems for PCTL unbounded until property PJoin_p(Æ₁UÆ₂) (where Join |X| {<, d, >, e}) using the computation of P d ₀(Æ₁UÆ₂). The approach is first proposed by Sen et al. in CAV'05 but ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Software Engineering and Methodology

ACM Transactions on Software Engineering and Methodology Volume 21, Issue 3

June 2012

239 pages

ISSN:1049-331X

EISSN:1557-7392

DOI:10.1145/2211616

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2012

Accepted: 01 February 2011

Revised: 01 December 2010

Received: 01 June 2010

Published in TOSEM Volume 21, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Division of Computing and Communication Foundations

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
364
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Su GRosenblum DTamburrelli GDillon LVisser WWilliams L(2016)Reliability of Run-Time Quality-of-Service evaluation using parametric model checkingProceedings of the 38th International Conference on Software Engineering10.1145/2884781.2884814(73-84)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2884781.2884814
Basu ABensalem SBozga MDelahaye BLegay A(2011)Statistical abstraction and model-checking of large heterogeneous systemsInternational Journal on Software Tools for Technology Transfer10.1007/s10009-011-0201-214:1(53-72)Online publication date: 21-May-2011
https://doi.org/10.1007/s10009-011-0201-2

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents