How visual cognition influences process model comprehension
Introduction
Business process models play an important role in different phases of the business process management lifecycle [1]: These models structure the overall process landscape, they serve as input for analysis, and they can be used as blueprints for process implementation. Business process models (or process models for short) are created and utilized collaboratively by process analysts, process owners, process participants, and senior management. They should be presented and designed in such a way that these different stakeholders can best utilize them for the respective tasks at hand.
A prerequisite for an effective usage of process models is that stakeholders can readily understand them. Recent research has investigated process model comprehension by evaluating different types of factors, including model complexity [2], [3] as well as model reader characteristics [4], [5], [6]. What if we now consider the same model and the same model reader while the comprehension tasks differ? Existing work does not provide any explanation why certain comprehension tasks appear to be easy to solve and others difficult [7]. Yet, understanding the reasons why certain comprehension tasks are difficult bears the potential to support modeling in a more effective way. First of all, based on such insights, tool features can be designed to help the model viewer in reading and understanding a model. Second, modelers can be directed to those parts of their model that are likely to be difficult to understand by the intended readership.
In this paper, we address this research gap from a theoretical angle. We analyze the comprehension process from the perspective of visual cognition in order to build hypotheses of comprehension task performance in relation to process models. We test our hypotheses using a free-simulation experimental design [8] in order to integrate visual cognition data from an eye-tracking device. The results underline the importance of visual cognition for process model comprehension. Factors associated with visual cognition explain a good share of the overall variance in comprehension performance and mediate classical factors such as model complexity and personal differences. This has implications for designing process models in practice and for research on conceptual models altogether.
The rest of the paper is structured as follows. Section 2 summarizes prior research on process model comprehension and develops hypotheses based on visual cognition. Section 3 presents the design of our study, and Section 4 provides the results. Section 5 discusses implications of this research. Section 6 concludes the paper and points to directions of future research.
Section snippets
Background
In this section, we present the background of our research. First, we summarize prior research on process model comprehension. Then, we discuss visual cognition and its link to the notion of a relevant region. Finally, we present our research question along with corresponding hypotheses.
Research method
To examine the role of visual cognition in process model comprehension, we designed a free-simulation experiment [8] based on an eye-tracking observation method. Free-simulation experiments are different from traditional factorial experiment designs in that subjects are confronted with tasks and asked to respond to them. Therefore, we can use them to uncover connections between variables that are not exactly binary factors. Our research is specifically focused on visual cognition efficiency and
Results
This section presents the results of our experiment, following the recommendations of [35]. First, we provide an overview of the data by summarizing descriptive statistics and screen it for correlations. Second, for testing H1, H2, we evaluate regression models linking Expertise and Model independent variables to Visual Cognition. Then, Hypothesis H3 is tested by comparing the explanatory power of regression models including the state-of-the-art literature model factors (i.e. Elements and
Discussion
This section discusses the implications of our research findings. Section 5.1 summarizes the results. Section 5.2 discusses implications for research and practice. Section 5.3 clarifies potential threats to the validity of our study.
Conclusions
In this paper, we found that visual cognition variables outperform model complexity and personal knowledge, in terms of familiarity, in explaining the variance of Task Duration and efficiency. Furthermore, we find that the statistical effect of model complexity and familiarity is fully mediated by visual cognition variables for all considered performance variables.
Our findings have strong implications for future research on process model comprehension. It emphasizes the relevance of
Acknowledgement
This work was supported by UBB-GTC grant no. 34018/2013. We would also like to thank all the people who participated in this study.
Razvan Petrusel is an Associate Professor with the Department of Business Information Systems of the Faculty of Economics and Business Administration in Babeș-Bolyai University of Cluj-Napoca, Romania. He received his Ph.D. in Cybernetics and Statistics in 2008 from Babeș-Bolyai University. His research interests, as well as teaching, include Business Process Management, Conceptual Modeling, Decision Modeling and Mining, and Process Mining. He published and presented over 40 research papers in
References (40)
- et al.
Fundamentals of Business Process Management
(2013) - et al.
A study into the factors that influence the understandability of business process models
Syst. Man Cybern. Part A Syst. Hum. IEEE Trans.
(2011) - et al.
Factors of process model comprehension—findings from a series of experiments
Decis. Support. Syst.
(2012) - et al.
The effects of content presentation format and user characteristics on novice developers' understanding of process models
CAIS
(2011) Continued use of process modeling grammars: the impact of individual difference factors
Eur. J. Inf. Syst.
(2010)- et al.
The effects of decomposition quality and multiple forms of information on novices' understanding of a domain from a conceptual model
JAIS
(2008) - et al.
Influence factors for local comprehensibility of process models
Int. J. Hum. Comput. Stud.
(2015) - et al.
Laboratory Experimentation
(1972) Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions
DKE
(2005)- et al.
Process model comprehension: the effects of cognitive abilities, learning style, and strategy
CAIS
(2014)
A framework for empirical evaluation of conceptual modeling techniques
Requir. Eng.
What makes process models understandable?
Evaluating workflows and web process complexity
Measurement in business processes: a systematic review
Bus. Process. Manag. J.
Structuring acyclic process models
Inf. Syst.
The influence of notational deficiencies on process model comprehension
J. Assoc. Inf. Syst.
Do ontological deficiencies in modeling grammars matter?
MIS Q.
How much language is enough? Theoretical and practical use of the business process modeling notation
Does cognitive overload matter in understanding bpmn models?
J. Comput. Inf. Syst.
Syntax highlighting in business process models
Decis. Support. Syst.
Cited by (55)
An amalgamation of cognitive aspects in software engineering: A content analysis
2024, Expert Systems with ApplicationsThe effects of modular process models on gaze patterns - A follow-up investigation about modularization in process model literacy
2024, Expert Systems with ApplicationsDefining gaze patterns for process model literacy – Exploring visual routines in process models with diverse mappings
2023, Expert Systems with ApplicationsCitation Excerpt :Further, as shown by the authors in (Bera, Soffer & Parsons, 2019), different eye movement parameters may constitute indicators for high cognitive load, whereas research in (Petrusel, Mendling & Reijers, 2016) and (Winter, Pryss, Probst & Reichert, 2021) demonstrated that visual cues support the reading and comprehension of process models. Finally, the authors in (Petrusel, Mendling & Reijers, 2017) provide insights into how visual cognition affects process model comprehension. In summary, despite all conducted works in the context of process model literacy, no work has addressed so far visual information processing in terms of visual routines and elemental operations during the comprehension of process models.
Business process and rule integration approaches—An empirical analysis of model understanding
2022, Information SystemsCitation Excerpt :Eye tracking equipment measures the biometric condition and movements of the eye, and has been widely used in IS research, especially in the field of conceptual models [78,79,94,95]. For example, eye fixation duration has been shown to be a valid behavioral measurement of cognitive load [96–99], and visual attention [100,101], visual cognition efficiency, and intensity [95,102] were found to be correlated with high task performance. Eye movements consist of fixations and saccades [103].
Process model abstraction for rapid comprehension of complex business processes
2022, Information SystemsCitation Excerpt :Process model comprehension is a research area that attracts a lot of attention by the research community. A vast body of research focuses on studying the factors that influence process model comprehension [35–38] and methods to get new insights on process model comprehension [39–41]. Also, techniques have been proposed that enrich process models to foster their comprehension [42–44].
Razvan Petrusel is an Associate Professor with the Department of Business Information Systems of the Faculty of Economics and Business Administration in Babeș-Bolyai University of Cluj-Napoca, Romania. He received his Ph.D. in Cybernetics and Statistics in 2008 from Babeș-Bolyai University. His research interests, as well as teaching, include Business Process Management, Conceptual Modeling, Decision Modeling and Mining, and Process Mining. He published and presented over 40 research papers in journals (e.g. Information and Software Technology) and at conferences (e.g. CaISE, BIS).
Jan Mendling is a Full Professor with the Institute for Information Business at Wirtschaftsuniversität Wien (WU Vienna), Austria. His research interests include various topics in the area of business process management and information systems. He has published > 250 research papers and articles, among others in ACM Transactions on Software Engineering and Methodology, IEEE Transaction on Software Engineering, Information Systems, Data & Knowledge Engineering, and Decision Support Systems. He is member of the editorial board of seven international journals, member of the board of the Austrian Society for Process Management (http://prozesse.at), one of the founders of the Berlin BPM Community of Practice (http://www.bpmb.de), organizer of several academic events on process management, and member of the IEEE Task Force on Process Mining. His Ph.D. thesis has won the Heinz-Zemanek-Award of the Austrian Computer Society and the German Targion-Award for dissertations in the area of strategic information management.
Hajo Reijers is a full professor in Business Informatics at the Department of Computer Science of the Vrije Universiteit Amsterdam (VU), where he is head of the Business Informatics group. Furthermore, he is a part-time full professor in the AIS group of the Department of Mathematics and Computer Science of Eindhoven University of Technology (TU/e). His research and teaching focus on business process management, workflow technology, business process improvement, and conceptual modeling. On these and related topics, he published over 150 research papers, book chapters and professional publications. He is also the managing director of the European BPM Round Table, an initiative to connect researchers and practitioners in the area of Business Process Management («http://www.bpmroundtable.eu/»). He is closely cooperating with companies from the services and healthcare domains, as well as with various international scholars.