Abstract
Process performance measurement assesses how well a process is running, covering various dimensions such as time, cost, and quality. This task involves the definition of measurable Process Performance Indicators (PPIs), which in many cases are calculated based on data recorded in an event log. An inhibitor of effective performance analysis is that establishing PPI definitions measurable from event logs is highly complex, because it requires process analytical expertise, as well as in-depth knowledge about the structure and contents of the available event data. Given that managers typically do not have such knowledge, this means that those stakeholders that are generally most interested in measuring process performance cannot do so in a convenient manner. Recognizing this, we bridge this gap by proposing an approach for the measurement of process performance based on textual descriptions and event logs, which combines state-of-the-art natural language processing techniques with matching strategies that are tailored to the task at hand. Evaluation experiments using textual descriptions provided by both industry and academic users demonstrate the accuracy of our approach.
This work has been partially supported by projects PID2021-126227NB-C21/ AEI/10.13039/501100011033/ FEDER, UE; TED2021-131023B-C22/ AEI/10.13039/501100011033/ Unión Europea NextGenerationEU/PRTR, and US-1381595 (Junta de Andalucía/FEDER, UE).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
\((>, 0)\) is used to count the cases for which this activity happens at least once.
- 2.
Tag O indicates that a chunk does not belong to any entity from the tag set.
- 3.
- 4.
We use the en_core_web_lg model provided by spacy (https://spacy.io/).
- 5.
We again use the Spacy library for this.
- 6.
More information, our prototype, and links to the materials can be found at https://github.com/isa-group/ppinat.
References
van der Aa, H., Leopold, H., del Río-Ortega, A., Resinas, M., Reijers, H.A.: Transforming unstructured natural language descriptions into measurable process performance indicators using hidden markov models. Inf. Syst. 71, 27–39 (2017)
Barbieri, L., Madeira, E.R.M., Stroeh, K., van der Aalst, W.M.P.: Towards a natural language conversational interface for process mining. In: Munoz-Gama, J., Lu, X. (eds.) ICPM 2021. LNBIP, vol. 433, pp. 268–280. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-98581-3_20
Barbieri, L., Madeira, E.R.M., Stroeh, K., van der Aalst, W.M.: A natural language querying interface for process mining. J. Intell. Inf. Syst. (2022). https://doi.org/10.1007/s10844-022-00759-9
del-Río-Ortega, A., Resinas, M., Durán, A., et al.: Visual PPINOT: a graphical notation for process performance indicators. Bus. Inf. Syst. Eng. 61(2), 137–161 (2019)
van Dongen, B.: BPI challenge 2020 domestic declarations. https://doi.org/10.4121/uuid:52fb97d4-4588-43c9-9d04-3604d4613b51
Eisenschlos, J.M., Gor, M., Müller, T., Cohen, W.W.: MATE: multi-view attention for table transformer efficiency (2021)
Herzig, J., Nowak, P.K., Müller, T., Piccinno, F., Eisenschlos, J.: TaPas: weakly supervised table parsing via pre-training. In: ACL, pp. 4320–4333 (2020)
Hui, B., et al.: Improving text-to-SQL with schema dependency learning. arXiv preprint arXiv:2103.04399 (2021)
Janiesch, C., Matzner, M.: BAMN: a modeling method for business activity monitoring systems. J. Decis. Syst. 28(3), 185–223 (2019)
Katsogiannis-Meimarakis, G., Koutrika, G.: A survey on deep learning approaches for text-to-SQL. VLDB J. 32, 905–936 (2023)
Kobeissi, M., Assy, N., Gaaloul, W., Defude, B., Haidar, B.: An intent-based natural language interface for querying process execution data. In: ICPM, pp. 152–159. IEEE (2021)
de Leoni, M., Mannhardt, F.: Road traffic fine management process. https://doi.org/10.4121/uuid:270fd440-1057-4fb9-89a9-b699b47990f5 (2015)
Popova, V., Sharpanskykh, A.: Modeling organizational performance indicators. Inf. Syst. 35(4), 505–527 (2010)
Reimers, N., Gurevych, I.: Sentence-BERT: sentence embeddings using Siamese BERT-networks. In: EMNLP. ACL, November 2019
Resinas, M., del Río-Ortega, A., Ruiz-Cortés, A.: PPINOT computer and ppinot4py: Two libraries to compute process performance indicators. In: ICPM (Demo track) (2021)
del Río-Ortega, A., Resinas, M., Cabanillas, C., Ruiz-Cortés, A.: On the definition and design-time analysis of process performance indicators. Inf. Syst. 38(4), 470–490 (2013)
del Río-Ortega, A., Resinas, M., et al.: Using templates and linguistic patterns to define process performance indicators. Ent. Inf. Sys. 10(2), 159–192 (2016)
Sanh, V., Debut, L., Chaumond, J., Wolf, T.: DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108 (2019)
Vogelgesang, T., Ambrosy, J., Becher, D., Seilbeck, R., Geyer-Klingeberg, J., Klenk, M.: Celonis PQl: a query language for process mining. In: Polyvyanyy, A. (ed.) Process Querying Methods, pp. 377–408. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-92875-9_13
Wang, H., Li, J., Wu, H., Hovy, E., Sun, Y.: Pre-trained language models and their applications. Engineering (2022)
Wetzstein, B., Ma, Z., Leymann, F.: Towards measuring key performance indicators of semantic business processes. In: Abramowicz, W., Fensel, D. (eds.) BIS 2008. LNBIP, vol. 7, pp. 227–238. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-79396-0_20
Yin, W., Hay, J., Roth, D.: Benchmarking zero-shot text classification: datasets, evaluation and entailment approach. In: EMNLP, pp. 3914–3923 (2019)
Acknowledgments
We thank Maria Isabel Ramos and Javier Vilariño for their support in the implementation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Resinas, M., del-Río-Ortega, A., van der Aa, H. (2023). From Text to Performance Measurement: Automatically Computing Process Performance Using Textual Descriptions and Event Logs. In: Di Francescomarino, C., Burattin, A., Janiesch, C., Sadiq, S. (eds) Business Process Management. BPM 2023. Lecture Notes in Computer Science, vol 14159. Springer, Cham. https://doi.org/10.1007/978-3-031-41620-0_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-41620-0_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-41619-4
Online ISBN: 978-3-031-41620-0
eBook Packages: Computer ScienceComputer Science (R0)