Abstract
Much efforts are aimed at unveiling the factors that influence a person’s comprehension of a business process model. While various potential factors have been proposed and studied in an experimental setting, little attention is being paid to reliability and validity requirements on measuring a person’s structural understanding of a process model. This paper proposes the concepts to meaningfully argue about these notions, for the sake of improving future measurement instruments. The findings from an experiment, involving 178 students from three different universities, underline the importance of this topic. In particular, it is shown that the coverage of model-related questions is important. This paper provides various recommendations to properly measure structural model comprehension.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Recker, J., Dreiling, A.: Does it matter which process modelling language we teach or use? An experimental study on understanding process modelling languages without formal education. In: Proceedings of the 18th Australasian Conference on Information Systems (ACIS 2007), pp. 356–366 (2007)
Sarshar, K., Loos, P.: Comparing the control-flow of EPC and Petri net from the end-user perspective. In: van der Aalst, W.M.P., Benatallah, B., Casati, F., Curbera, F. (eds.) BPM 2005. LNCS, vol. 3649, pp. 434–439. Springer, Heidelberg (2005)
Moher, T.G., Mak, D.C., Blumenthal, B., Leventhal, L.M.: Comparing the comprehensibility of textual and graphical programs: The case of petri nets. In: Cook, C.R., Scholtz, J.C., Spohrer, J.C. (eds.) Empirical Studies of Programmers: Fifth Workshop: Papers Presented at the Fifth Workshop on Empirical Studies of Programmers, pp. 137–161 (1993)
Reijers, H.A., Mendling, J.: Modularity in process models: Review and effects. In: Dumas, M., Reichert, M., Shan, M.-C. (eds.) BPM 2008. LNCS, vol. 5240, pp. 20–35. Springer, Heidelberg (2008)
Mendling, J.: Metrics for Process Models: Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness. LNBIP, vol. 6. Springer, Heidelberg (2008)
Vanderfeesten, I., Reijers, H.A., Mendling, J., van der Aalst, W.M.P., Cardoso, J.: On a quest for good process models: The cross-connectivity metric. In: Bellahsène, Z., Léonard, M. (eds.) CAiSE 2008. LNCS, vol. 5074, pp. 480–494. Springer, Heidelberg (2008)
Green, T.R.G., Petre, M.: Usability analysis of visual programming environments: A ‘cognitive dimensions’ framework. Journal of Visual Languages and Computing 7(2), 131–174 (1996)
Mendling, J., Reijers, H.A., Cardoso, J.: What makes process models understandable? In: Alonso, G., Dadam, P., Rosemann, M. (eds.) BPM 2007. LNCS, vol. 4714, pp. 48–63. Springer, Heidelberg (2007)
Mendling, J., Strembeck, M.: Influence factors of understanding business process models. In: Abramowicz, W., Fensel, D. (eds.) BIS 2008. LNBIP, vol. 7, pp. 142–153. Springer, Heidelberg (2008)
Melcher, J., Seese, D.: Towards validating prediction systems for process understandability: Measuring process understandability. In: Negru, V., Jebelean, T., Petcu, D., Zaharie, D. (eds.) Proceedings of the 10th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC 2008), pp. 564–571 (2008)
Melcher, J., Seese, D.: Towards validating prediction systems for process understandability: Measuring process understandability (experimental results). Research report, Universität Karlsruhe (TH), Institut AIFB (2008), http://digbib.ubka.uni-karlsruhe.de/volltexte/1000009260
Melcher, J., Mendling, J., Reijers, H.A., Seese, D.: On measuring the understandability of process models (experimental results). Research report, Universität Karlsruhe (TH), Institut AIFB, Humboldt-Universität, Berlin, Eindhoven University of Technology (2009), http://digbib.ubka.uni-karlsruhe.de/volltexte/1000011993
Kan, S.H.: Metrics and Models in Software Quality Engineering, 2nd edn. Addison-Wesley, Reading (2002)
Panik, M.J.: Advanced Statistics from an Elementary Point of View. Elsevier Academic Press, Amsterdam (2005)
Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3-4), 591–611 (1965)
Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman & Hall, Boca Raton (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Melcher, J., Mendling, J., Reijers, H.A., Seese, D. (2010). On Measuring the Understandability of Process Models. In: Rinderle-Ma, S., Sadiq, S., Leymann, F. (eds) Business Process Management Workshops. BPM 2009. Lecture Notes in Business Information Processing, vol 43. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12186-9_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-12186-9_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12185-2
Online ISBN: 978-3-642-12186-9
eBook Packages: Computer ScienceComputer Science (R0)