Skip to main content

FunSpec4DTMC – A Tool for Modelling Discrete-Time Markov Chains Using Functional Specification

  • Conference paper
  • First Online:
  • 776 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 10740))

Abstract

We present a tool for the analysis of finite discrete-time Markov chains (DTMCs). As a novelty, the tool offers functional specification of DTMCs and implements forward algorithms to compute the stationary state distribution \(x_s\) of the DTMC or derive its transition matrix P [19]. In addition, we implement nine direct and indirect algorithms to compute various metrics of DTMCs based on P including an algorithm to determine the period of the DTMC. The tool is intended for both production purposes and as platform for teaching the functional specification of DTMCs. It is published under GPLv3 [3] on Github [2].

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Cython: C-Extensions for Python. http://cython.org/. Accessed 6 Nov 2017

  2. Github: FunSpec4DTMC. https://github.com/uni-tue-kn/funspec4dtmc. Accessed 6 Nov 2017

  3. GNU General Public License 3. https://www.gnu.org/licenses/gpl-3.0.en.html. Accessed 6 Nov 2017

  4. Matplotlib 2.1.0. https://matplotlib.org/. Accessed 6 Nov 2017

  5. NumPy - Scientific Computing with Python. http://www.numpy.org/. Accessed 6 Nov 2017

  6. PyPI: discreteMarkovChain. https://pypi.python.org/pypi/discreteMarkovChain. Accessed 6 Nov 2017

  7. PyQt5. http://www.numpy.org/. Accessed 6 Nov 2017

  8. Python 3.6.3. https://www.python.org/downloads/release/python-363/. Accessed 6 Nov 2017

  9. Qt. https://www.qt.io/. Accessed 6 Nov 2017

  10. Qt5: Signals & Slots. http://doc.qt.io/qt-5/signalsandslots.html. Accessed 6 Nov 2017

  11. SciPy. https://www.scipy.org/. Accessed 6 Nov 2017

  12. tkinter. https://docs.python.org/3.6/library/tkinter.html. Accessed 6 Nov 2017

  13. Benoit, A., Brenner, L., Fernandes, P., Plateau, B., Stewart, W.J.: The Peps software tool. In: Kemper, P., Sanders, W.H. (eds.) TOOLS 2003. LNCS, vol. 2794, pp. 98–115. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45232-4_7

    Chapter  Google Scholar 

  14. Bini, D.A., et al.: Structured Markov chains solver: software tools. In: Proceedings of the Workshop on Tools for Solving Structured Markov Chains (SMCtools 2006). ACM (2006)

    Google Scholar 

  15. Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley, Boston (1995)

    MATH  Google Scholar 

  16. Hermanns, H., Joubert, C.: A set of performance and dependability analysis components for CADP. In: Garavel, H., Hatcliff, J. (eds.) TACAS 2003. LNCS, vol. 2619, pp. 425–430. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-36577-X_30

    Chapter  Google Scholar 

  17. Katoen, J.P., et al.: The Ins and Outs of the probabilistic model checker MRMC. In: Proceedings of the 6th International Conference on the Quantitative Evaluation of Systems (QUEST 2009). IEEE Computer Society Press (2009)

    Google Scholar 

  18. Kwiatkowska, M., Norman, G., Parker, D.: PRISM 4.0: verification of probabilistic real-time systems. In: Gopalakrishnan, G., Qadeer, S. (eds.) CAV 2011. LNCS, vol. 6806, pp. 585–591. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22110-1_47

    Chapter  Google Scholar 

  19. Menth, M.: Description and analysis of Markov chains based on recursive stochastic equations and factor distributions. World J. Model. Simul. 7(1), 3–15 (2011)

    Google Scholar 

  20. Spedicato, G.A., Kang, T.S., Yalamanchi, S.B., Yadav, D.: The markovchain Package: A Package for Easily Handling Discrete Markov Chains in R. https://cran.r-project.org/web/packages/markovchain/vignettes/an_introduction_to_markovchain_package.pdf

  21. Stewart, W.J.: Introduction to the Numerical Solution of Markov Chains. Princeton University Press, Princeton (1994)

    MATH  Google Scholar 

  22. Stewart, W.J.: Probability, Markov Chains, Queues, and Simulation: The Mathematical Basis of Performance Modeling. Princeton University Press, Princeton (2009)

    MATH  Google Scholar 

  23. Timmer, M., Katoen, J.-P., van de Pol, J., Stoelinga, M.I.A.: Efficient modelling and generation of Markov automata. In: Koutny, M., Ulidowski, I. (eds.) CONCUR 2012. LNCS, vol. 7454, pp. 364–379. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-32940-1_26

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Frederik Hauser , Dominik Krauß or Michael Menth .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hauser, F., Krauß, D., Menth, M. (2018). FunSpec4DTMC – A Tool for Modelling Discrete-Time Markov Chains Using Functional Specification. In: German, R., Hielscher, KS., Krieger, U. (eds) Measurement, Modelling and Evaluation of Computing Systems. MMB 2018. Lecture Notes in Computer Science(), vol 10740. Springer, Cham. https://doi.org/10.1007/978-3-319-74947-1_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-74947-1_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74946-4

  • Online ISBN: 978-3-319-74947-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics