Abstract
Business process modeling aims to enhance the comprehension of company processes, enabling decision-makers to attain strategic objectives. Nevertheless, inexperienced systems analysts who lack domain knowledge may produce low-quality models, thereby impacting the overall effectiveness of the modeling process. Large language models are bringing about a revolutionary transformation in the application of knowledge within various domains. This paper presents preliminary experimental findings on the potential application of Large language models in Business Process Modeling semantic quality improvement, specifically focusing on the extent to which these technologies can aid the modeler by suggesting improvements. In our study, we delve into the knowledge of GPT-4, a powerful language model. We aim to investigate its capabilities by employing various combinations of prompts, incorporating proposed textual syntax, and integrating contextual domain knowledge. Our objective is to leverage these approaches to improve the quality of business process models. Our findings indicate that the knowledge generated by GPT-4 is predominantly generic, encompassing ambiguous and general concepts that extend beyond the specific domain. However, when we apply our proposed prompting techniques, we observe a notable improvement in the specificity and comprehensiveness of the results. The utilization of these prompts helps to refine the generated knowledge, leading to more specific and comprehensive outcomes that align closely with the intended domain.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
van der Aa, H., Di Ciccio, C., Leopold, H., Reijers, H.A.: Extracting declarative process models from natural language. In: Giorgini, P., Weber, B. (eds.) CAiSE 2019. LNCS, vol. 11483, pp. 365–382. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21290-2_23
de Almeida Bordignon, A.C., Thom, L.H., Silva, T.S., Dani, V.S., Fantinato, M., Ferreira, R.C.B.: Natural language processing in business process identification and modeling: a systematic literature review. In: Proceedings of the XIV Brazilian Symposium on Information Systems, pp. 1–8 (2018)
Bellan, P., Dragoni, M., Ghidini, C.: Process extraction from text: state of the art and challenges for the future. arXiv preprint arXiv:2110.03754 (2021)
Bellan, P., Dragoni, M., Ghidini, C.: Extracting business process entities and relations from text using pre-trained language models and in-context learning. In: Almeida, J.P.A., Karastoyanova, D., Guizzardi, G., Montali, M., Maggi, F.M., Fonseca, C.M. (eds.) EDOC 2022. LNCS, vol. 13585, pp. 182–199. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-17604-3_11
Brown, T., et al.: Language models are few-shot learners. In: Advances in Neural Information Processing Systems, vol. 33, pp. 1877–1901 (2020)
DAIR.AI: Basics of prompting (2023). Accessed 31 Oct 2023
Ferreira, R.C.B., Thom, L.H., Fantinato, M.: A semi-automatic approach to identify business process elements in natural language texts. In: International Conference on Enterprise Information Systems, vol. 2, pp. 250–261. SCITEPRESS (2017)
Honkisz, K., Kluza, K., Wiśniewski, P.: A concept for generating business process models from natural language description. In: Liu, W., Giunchiglia, F., Yang, B. (eds.) KSEM 2018. LNCS (LNAI), vol. 11061, pp. 91–103. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99365-2_8
Kojima, T., Gu, S.S., Reid, M., Matsuo, Y., Iwasawa, Y.: Large language models are zero-shot reasoners. In: Advances in Neural Information Processing Systems, vol. 35, pp. 22199–22213 (2022)
Krogstie, J., Lindland, O.I., Sindre, G.: Defining quality aspects for conceptual models. In: Information System Concepts: Towards a Consolidation of Views, pp. 216–231 (1995)
Leopold, H., Mendling, J., Polyvyanyy, A.: Generating natural language texts from business process models. In: Ralyté, J., Franch, X., Brinkkemper, S., Wrycza, S. (eds.) CAiSE 2012. LNCS, vol. 7328, pp. 64–79. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-31095-9_5
Maqbool, B., et al.: A comprehensive investigation of BPMN models generation from textual requirements—techniques, tools and trends. In: Kim, K.J., Baek, N. (eds.) ICISA 2018. LNEE, vol. 514, pp. 543–557. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1056-0_54
Narang, S., Raffel, C., Lee, K., Roberts, A., Fiedel, N., Malkan, K.: Wt5?! Training text-to-text models to explain their predictions. arXiv preprint arXiv:2004.14546 (2020)
Rolland, C., Proix, C.: A natural language approach for requirements engineering. In: Loucopoulos, P. (ed.) CAiSE 1992. LNCS, vol. 593, pp. 257–277. Springer, Heidelberg (1992). https://doi.org/10.1007/BFb0035136
SBVR, O.: Semantics of business vocabulary and business rules (SBVR), version 1.0 (2008)
Sholiq, S., Sarno, R., Astuti, E.S.: Generating BPMN diagram from textual requirements. J. King Saud University-Comput. Inf. Sci. 34(10), 10079–10093 (2022)
Si-Said Cherfi, S., Ayad, S., Comyn-Wattiau, I.: Improving business process model quality using domain ontologies. J. Data Semant. 2, 75–87 (2013)
Wang, J., et al.: Prompt engineering for healthcare: methodologies and applications. arXiv preprint arXiv:2304.14670 (2023)
Wei, J., et al.: Chain-of-thought prompting elicits reasoning in large language models. In: Advances in Neural Information Processing Systems, vol. 35, pp. 24824–24837 (2022)
Acknowledgement
Author would like to thank Arab Open University for supporting this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ayad, S., AlSayoud, F. (2024). Exploring ChatGPT Prompt Engineering for Business Process Models Semantic Quality Improvement. In: Rocha, Á., Adeli, H., Dzemyda, G., Moreira, F., Poniszewska-Marańda, A. (eds) Good Practices and New Perspectives in Information Systems and Technologies. WorldCIST 2024. Lecture Notes in Networks and Systems, vol 987. Springer, Cham. https://doi.org/10.1007/978-3-031-60221-4_39
Download citation
DOI: https://doi.org/10.1007/978-3-031-60221-4_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60220-7
Online ISBN: 978-3-031-60221-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)