Abstract
We present a tool for the analysis of finite discrete-time Markov chains (DTMCs). As a novelty, the tool offers functional specification of DTMCs and implements forward algorithms to compute the stationary state distribution \(x_s\) of the DTMC or derive its transition matrix P [19]. In addition, we implement nine direct and indirect algorithms to compute various metrics of DTMCs based on P including an algorithm to determine the period of the DTMC. The tool is intended for both production purposes and as platform for teaching the functional specification of DTMCs. It is published under GPLv3 [3] on Github [2].
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Cython: C-Extensions for Python. http://cython.org/. Accessed 6 Nov 2017
Github: FunSpec4DTMC. https://github.com/uni-tue-kn/funspec4dtmc. Accessed 6 Nov 2017
GNU General Public License 3. https://www.gnu.org/licenses/gpl-3.0.en.html. Accessed 6 Nov 2017
Matplotlib 2.1.0. https://matplotlib.org/. Accessed 6 Nov 2017
NumPy - Scientific Computing with Python. http://www.numpy.org/. Accessed 6 Nov 2017
PyPI: discreteMarkovChain. https://pypi.python.org/pypi/discreteMarkovChain. Accessed 6 Nov 2017
PyQt5. http://www.numpy.org/. Accessed 6 Nov 2017
Python 3.6.3. https://www.python.org/downloads/release/python-363/. Accessed 6 Nov 2017
Qt. https://www.qt.io/. Accessed 6 Nov 2017
Qt5: Signals & Slots. http://doc.qt.io/qt-5/signalsandslots.html. Accessed 6 Nov 2017
SciPy. https://www.scipy.org/. Accessed 6 Nov 2017
tkinter. https://docs.python.org/3.6/library/tkinter.html. Accessed 6 Nov 2017
Benoit, A., Brenner, L., Fernandes, P., Plateau, B., Stewart, W.J.: The Peps software tool. In: Kemper, P., Sanders, W.H. (eds.) TOOLS 2003. LNCS, vol. 2794, pp. 98–115. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45232-4_7
Bini, D.A., et al.: Structured Markov chains solver: software tools. In: Proceedings of the Workshop on Tools for Solving Structured Markov Chains (SMCtools 2006). ACM (2006)
Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley, Boston (1995)
Hermanns, H., Joubert, C.: A set of performance and dependability analysis components for CADP. In: Garavel, H., Hatcliff, J. (eds.) TACAS 2003. LNCS, vol. 2619, pp. 425–430. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-36577-X_30
Katoen, J.P., et al.: The Ins and Outs of the probabilistic model checker MRMC. In: Proceedings of the 6th International Conference on the Quantitative Evaluation of Systems (QUEST 2009). IEEE Computer Society Press (2009)
Kwiatkowska, M., Norman, G., Parker, D.: PRISM 4.0: verification of probabilistic real-time systems. In: Gopalakrishnan, G., Qadeer, S. (eds.) CAV 2011. LNCS, vol. 6806, pp. 585–591. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22110-1_47
Menth, M.: Description and analysis of Markov chains based on recursive stochastic equations and factor distributions. World J. Model. Simul. 7(1), 3–15 (2011)
Spedicato, G.A., Kang, T.S., Yalamanchi, S.B., Yadav, D.: The markovchain Package: A Package for Easily Handling Discrete Markov Chains in R. https://cran.r-project.org/web/packages/markovchain/vignettes/an_introduction_to_markovchain_package.pdf
Stewart, W.J.: Introduction to the Numerical Solution of Markov Chains. Princeton University Press, Princeton (1994)
Stewart, W.J.: Probability, Markov Chains, Queues, and Simulation: The Mathematical Basis of Performance Modeling. Princeton University Press, Princeton (2009)
Timmer, M., Katoen, J.-P., van de Pol, J., Stoelinga, M.I.A.: Efficient modelling and generation of Markov automata. In: Koutny, M., Ulidowski, I. (eds.) CONCUR 2012. LNCS, vol. 7454, pp. 364–379. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-32940-1_26
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Hauser, F., Krauß, D., Menth, M. (2018). FunSpec4DTMC – A Tool for Modelling Discrete-Time Markov Chains Using Functional Specification. In: German, R., Hielscher, KS., Krieger, U. (eds) Measurement, Modelling and Evaluation of Computing Systems. MMB 2018. Lecture Notes in Computer Science(), vol 10740. Springer, Cham. https://doi.org/10.1007/978-3-319-74947-1_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-74947-1_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-74946-4
Online ISBN: 978-3-319-74947-1
eBook Packages: Computer ScienceComputer Science (R0)