Abstract
Today’s organizations store lots of data tracking the execution of their business processes. These data often contain valuable information that can be used to predict the evolution of running process executions. The present paper investigates the combined use of Instance Graphs and Deep Graph Convolutional Neural Networks to predict which activity will be performed next given a partial process execution. In addition to the exploitation of graph structures to encode the control-flow information, we investigate how to couple it with additional data perspectives. Experiments show the feasibility of the proposed approach, whose outcomes are consistently placed in the top ranking then compared to those obtained by well-known state-of-the-art approaches.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
All datasets used in this paper to support the findings are publicly available. Links are reported in the bibliography.
Notes
For the sake of simplicity, we directly show the projected trace obtained by another trace from the Helpdesk log. Furthermore, for the sake of readability, we only use activity acronyms.
Note that for deviations occurring within parallel constructs other repair configurations are available, e.g., by adding an additional parallel branch involving the inserted activities. Refer to Diamantini et al. (2016) for additional details.
Here we refer to the state-of-the-art notion of fitness proposed by Adriansyah et al. (2011)
References
Abadi, M., Agarwal, A., Sutskever, I., & et al. (2015). TensorFlow: Large-scale machine learning on heterogeneous systems. https://www.tensorflow.org/, software available from tensorflow.org. Accessed 15 Sept 2022.
Adriansyah, A., van Dongen, B.F., & van der Aalst, W.M. (2011). Conformance checking using cost-based fitness analysis. In 2011 IEEE 15th international enterprise distributed object computing conference (pp. 55–64). IEEE.
Appice, A., Di Mauro, N., & Malerba, D. (2019). Leveraging shallow machine learning to predict business process behavior. In 2019 IEEE international conference on services computing (SCC) (pp. 184–188). IEEE.
Becker, J., Breuker, D., Delfmann, P., & et al. (2014). Designing and implementing a framework for event-based predictive modelling of business processes. pp 71–84.
Brazdil, P.B., & Soares, C. (2000). A comparison of ranking methods for classification algorithm selection. In R. López de Mántaras E. Plaza (Eds.) Machine Learning: ECML 2000 (pp. 63–75). Berlin: Springer.
Camargo, M., Dumas, M., & González-Rojas, O. (2019). Learning accurate LSTM models of business processes. In Proceedings of the 17th international conference on business process management (BPM’19), Lecture Notes in Computer Science, (Vol. 11675 pp. 286–302).
Castellanos, M., Salazar, N., Casati, F., & et al. (2006). Predictive business operations management. International Journal of Computational Science and Engineering, 2(5-6), 292–301.
Ceci, M., Lanotte, P.F., Fumarola, F., & et al. (2014). Completion time and next activity prediction of processes using sequential pattern mining. In International conference on discovery science (pp. 49–61). Springer.
Chiorrini, A., Diamantini, C., Mircoli, A., & et al. (2020). A preliminary study on the application of reinforcement learning for predictive process monitoring. In Proceedings of 2nd International Conference on Process Mining (ICPM20), Lecture Notes in Business Information Processing.
Chiorrini, A., Diamantini, C., Mircoli, A., & et al. (2021). Exploiting instance graphs and graph neural networks for next activity prediction. In Process mining workshops, Lecture Notes in Business Information Processing.
Di Francescomarino, C., Ghidini, C., Maggi, F.M., & et al. (2017). An eye into the future: leveraging a-priori knowledge in predictive business process monitoring. In International conference on business process management (pp. 252–268). Springer.
Di Francescomarino, C., Ghidini, C., Maggi, F.M., & et al. (2018). Predictive process monitoring methods: Which one suits me best? In M. Weske, M. Montali, I. Weber, & et al. (Eds.) Business Process Management (pp. 462–479). Cham: Springer International Publishing.
Diamantini, C., Genga, L., Potena, D., & et al. (2016). Building instance graphs for highly variable processes. Expert Systems with Applications, 59, 101–118.
van Dongen, B. (2012). BPI Challenge 2012. https://doi.org/10.4121/uuid:3926db30-f712-4394-aebc-75976070e91f. https://data.4tu.nl/articles/dataset/BPI_Challenge_2012/12689204.
van Dongen, B. (2020). BPI challenge 2020. https://doi.org/10.4121/uuid:52fb97d4-4588-43c9-9d04-3604d4613b51.
van Dongen, B.F., & van der Aalst, W.M.P. (2004). Multi-phase process mining: Building instance graphs. In P. Atzeni, W. Chu, H. Lu, & et al. (Eds.) Conceptual Modeling – ER 2004 (pp. 362–376). Berlin: Springer.
Evermann, J., Rehse, J.R., & Fettke, P. (2017a). Predicting process behaviour using deep learning. Decision Support Systems, 100, 129–140.
Evermann, J., Rehse, J.R., & Fettke, P. (2017b). Predicting process behaviour using deep learning. Decision Support Systems, 100, 129–140. Smart Business Process Management.
Fey, M., & Lenssen, J.E. (2019). Fast graph representation learning with PyTorch Geometric. In ICLR workshop on representation learning on graphs and manifolds.
Kingma, D.P., & Ba, J. (2015). Adam: A method for stochastic optimization. In Proceedings of the 3rd international conference on learning representations (ICLR 2015).
Lakshmanan, G., Shamsi, D., Doganata, Y., & et al. (2015). A Markov prediction model for data-driven semi-structured business processes. Knowledge and Information Systems, 42(1), 97–126.
Leemans, S.J.J., Fahland, D., & van der Aalst, W.M.P. (2014). Discovering block-structured process models from incomplete event logs. In G. Ciardo E. Kindler (Eds.) Application and theory of Petri nets and concurrency (pp. 91–110). Cham: Springer International Publishing.
Maggi, F.M., Francescomarino, C.D., Dumas, M., & et al. (2014). Predictive monitoring of business processes. In International conference on advanced information systems engineering (pp. 457–472). Springer.
Marquez-Chamorro, A., Resinas, M., & Ruiz-Cortes, A. (2018). Predictive monitoring of business processes: A survey. IEEE Transactions on Services Computing, 11(6), 962–977.
Metzger, A., & Neubauer, A. (2018). Considering non-sequential control flows for process prediction with recurrent neural networks. In 2018 44th Euromicro conference on software engineering and advanced applications (SEAA) (pp. 268–272). IEEE.
Pasquadibisceglie, V., Appice, A., Castellano, G., & et al. (2020). Predictive process mining meets computer vision. In Business process management forum (BPM’20), Lecture Notes in Business Information Processing (pp. 176–192).
Pasquadibisceglie, V., Appice, A., Castellano, G., & et al. (2021). A multi-view deep learning approach for predictive business process monitoring. IEEE Transactions on Services Computing.
Philipp, P., Jacob, R., Robert, S., & et al. (2020). Predictive analysis of business processes using neural networks with attention mechanism. pp 225–230.
Polato, M., Sperduti, A., Burattin, A., & et al. (2018). Time and activity sequence prediction of business process instances. Computing, 100(9), 1005–1031.
Rama-Maneiro, E., Vidal, J., & Lama, M. (2021). Deep learning for predictive business process monitoring: Review and benchmark. IEEE Transactions on Services Computing.
Srivastava, N., Hinton, G., Krizhevsky, A., & et al. (2014). Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(1), 1929–1958.
Tax, N., Verenich, I., La Rosa, M., & et al. (2017). Predictive business process monitoring with LSTM neural networks. In Advanced information systems engineering. CAiSE 2017. Lecture Notes in Computer Science (vol. 10253 pp. 477–492).
Taymouri, F., Rosa, M.L., Erfani, S., & et al. (2020). Predictive business process monitoring via generative adversarial nets: The case of next event prediction. In D. Fahland, C. Ghidini, J. Becker, & et al. (Eds.) Business Process Management (pp. 237–256). Cham: Springer International Publishing.
Teinemaa, I., Dumas, M., Rosa, M., & et al. (2019). Outcome-oriented predictive process monitoring: Review and benchmark. ACM Transactions on Knowledge Discovery from Data, 13(2).
Unuvar, M., Lakshmanan, G.T., & Doganata, Y.N. (2016). Leveraging path information to generate predictions for parallel business processes. Knowledge and Information Systems, 47(2), 433–461.
van der Aalst, W., van Dongen, B., Herbst, J., & et al. (2003). Workflow mining: A survey of issues and approaches. Data & Knowledge Engineering, 47(2), 237–267.
Van Der Aalst, W., Pesic, M., & Song, M. (2010). Beyond process mining: From the past to present and future. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6051 LNCS:38–52.
Van Der Aalst, W., Schonenberg, M., & Song, M. (2011). Time prediction based on process mining. Information Systems, 36(2), 450–475.
Venugopal, I., Tollich, J., Fairbank, M., & et al. (2021). A comparison of deep learning methods for analysing and predicting business processes. In Proceedings of international joint conference on neural networks, IJCNN.
Verenich, I. (2016). Helpdesk. https://doi.org/10.17632/39bp3vv62t.1.
Wu, Z., Pan, S., Chen, F., & et al. (2021). A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems, 32(1), 4–24.
Zhang, M., Cui, Z., Neumann, M., & et al. (2018). An end-to-end deep learning architecture for graph classification. In Proceedings of the AAAI conference on artificial intelligence.
Funding
No funding was received for conducting this study.
Author information
Authors and Affiliations
Contributions
Conceptualization: all authors; Methodology: all authors; Formal analysis and investigation: Andrea Chiorrini; Writing - original draft preparation: Andrea Chiorrini, Claudia Diamantini, Laurea Genga; Writing - review, editing and final approval: all authors; Supervision: Claudia Diamantini.
Corresponding author
Ethics declarations
Consent for Publication
All authors agree with the content and give explicit consent to submit.
Conflict of Interests
The authors have no financial or proprietary interests in any material discussed in this article.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chiorrini, A., Diamantini, C., Genga, L. et al. Multi-perspective enriched instance graphs for next activity prediction through graph neural network. J Intell Inf Syst 61, 5–25 (2023). https://doi.org/10.1007/s10844-023-00777-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10844-023-00777-1