AI-Driven Consistency of SysML Diagrams
Pages 149 - 159
Abstract
Graphical modeling languages, expected to simplify systems analysis and design, present a challenge in maintaining consistency across their varied views. Traditional rule-based methods for ensuring consistency in languages like UML often fall short in addressing complex semantic dimensions. Moreover, the integration of Large Language Models (LLMs) into Model Driven Engineering (MDE) introduces additional consistency challenges, as LLM's limited output contexts requires the integration of responses. This paper presents a new framework that automates the detection and correction of inconsistencies across different views, leveraging formally defined rules and incorporating OpenAI's GPT, as implemented in TTool. Focusing on the consistency between use case and block diagrams, the framework is evaluated through its application to three case studies, highlighting its potential to significantly enhance consistency management in graphical modeling.
References
[1]
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. GPT-4 technical report. arXiv preprint arXiv:2303.08774 (2023).
[2]
Aakash Ahmad, Muhammad Waseem, Peng Liang, Mahdi Fahmideh, Mst Shamima Aktar, and Tommi Mikkonen. 2023. Towards Human-Bot Collaborative Software Architecting with ChatGPT. In Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering. 279--285.
[3]
Ludovic Apvrille. and Bastien Sultan. 2024. System Architects are not Alone Anymore: Automatic System Modeling with AI. In Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - MODELSWARD'24. INSTICC, SciTePress, 27--38. https://doi.org/10.5220/0012320100003645
[4]
Oskar Berglund. 2024. Assessing Strategies for Behaviour Consistency Checking Using LLMs. B.Sc. Thesis.
[5]
Alessandro Tempia Calvino and Ludovic Apvrille. 2021. Direct Model-Checking of SysML Models. In 9th International Conference on Model-Driven Engineering and Software Development. SCITEPRESS-Science and Technology Publications, 216--223.
[6]
Javier Cámara, Javier Troya, Lola Burgueño, and Antonio Vallecillo. 2023. On the Assessment of Generative AI in Modeling Tasks: an Experience Report with ChatGPT and UML. Software and Systems Modeling 22, 3 (2023), 781--793.
[7]
Boqi Chen, Kua Chen, Shabnam Hassani, Yujing Yang, Daniel Amyot, Lysanne Lessard, Gunter Mussbacher, Mehrdad Sabetzadeh, and Dániel Varró. 2023. On the Use of GPT-4 for Creating Goal Models: An Exploratory Study. In 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW). IEEE, 262--271.
[8]
K. Chen, Y. Yang, B. Chen, J. Hernandez Lopez, G. Mussbacher, and D. Varro. 2023. Automated Domain Modeling with Large Language Models: AComparative Study. In 2023 ACM/IEEE 26th International Conference on Model Driven Engineering Languages and Systems (MODELS). IEEE Computer Society, 162--172. https://doi.org/10.1109/MODELS58315.2023.00037
[9]
Musheng Chen, Guowei He, and Junhua Wu. 2024. ZDDR: A Zero-Shot Defender for Adversarial Samples Detection and Restoration. IEEE Access (2024).
[10]
Sylvain Guérin, Joel Champeau, Jean-Christophe Bach, Antoine Beugnard, Fabien Dagnat, and Salvador Martínez. 2022. Multi-Level Modeling with Openflexo/FML: a contribution to the multi-level process challenge. Enterprise Modelling and Information Systems Architectures (EMISAJ) 17 (2022), 9--1.
[11]
Leon Görgen., Eric Müller., Marcus Triller., Benjamin Nast., and Kurt Sandkuhl. 2024. Large Language Models in Enterprise Modeling: Case Study and Experiences. In Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - MODELSWARD. INSTICC, SciTePress, 74--85. https://doi.org/10.5220/0012387000003645
[12]
David Harel., Guy Katz., Assaf Marron., and Smadar Szekely. 2024. On Augmenting Scenario-Based Modeling with Generative AI. In Proceedings of the 12th International Conference on Model-Based Software and Systems Engineering - MODELSWARD. INSTICC, SciTePress, 235--246. https://doi.org/10.5220/0012427100003645
[13]
Noraini Ibrahim, Rosziati Ibrahim, Mohd Zainuri Saringat, Dzahar Mansor, and Tutut Herawan. 2010. On well-formedness rules for UML use case diagram. In Web Information Systems and Mining: International Conference, WISM 2010, Sanya, China, October 23-24, 2010. Proceedings. Springer, 432--439.
[14]
Noraini Ibrahim, Rosziati Ibrahim, Mohd Zainuri Saringat, Dzahar Mansor, and Tutut Herawan. 2011. Consistency Rules Between UML Use Case and Activity Diagrams using Logical Approach. International Journal of Software Engineering and its Applications 5, 3 (2011), 119--134.
[15]
Diana Kalibatiene, Olegas Vasilecas, and Ruta Dubauskaite. 2013. Rule Based Approach for Ensuring Consistency in Different UML Models. In Information Systems: Development, Learning, Security: 6th SIGSAND/PLAIS EuroSymposium 2013, Gdańsk, Poland, September 26, 2013. Proceedings 6. Springer, 1--16.
[16]
Daniel Knorreck, Ludovic Apvrille, and Renaud Pacalet. 2013. Formal System-Level Design Space Exploration. Concurrency and Computation: Practice and Experience 25, 2 (2013), 250--264. https://doi.org/10.1002/cpe.2802 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/cpe.2802
[17]
Ziyu Li and Donghwan Shin. 2024. Mutation-Based Consistency Testing for Evaluating the Code Understanding Capability of LLMs. In Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering-Software Engineering for AI. 150--159.
[18]
Shan Lu, Alexey Tazin, Yanji Chen, Mieczyslaw M Kokar, and Jeff Smith. 2023. Detection of inconsistencies in SysML/OCL models using OWL reasoning. SN Computer Science 4, 2 (2023), 175.
[19]
Qin Ma, Pierre Kelsen, and Christian Glodt. 2015. A generic model decomposition technique and its application to the Eclipse modeling framework. Software & Systems Modeling 14 (2015), 921--952.
[20]
Tom Mens, Ragnhild Van Der Straeten, and Jocelyn Simmonds. 2005. A framework for managing consistency of evolving UML models. In Software Evolution with UML and XML. IGI Global, 1--30.
[21]
Hiroyuki Nakagawa and Shinichi Honiden. 2023. MAPE-K Loop-Based Goal Model Generation Using Generative AI. In 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW). IEEE, 247--251.
[22]
Gabriel Pedroza, Ludovic Apvrille, and Daniel Knorreck. 2011. AVATAR: A SysML Environment for the Formal Verification of Safety and Security Properties. In 2011 11th Annual International Conference on New Technologies of Distributed Systems. 1--10. https://doi.org/10.1109/NOTERE.2011.5957992
[23]
Iris Reinhartz-Berger. 2005. Conceptual Modeling of Structure and Behavior with UML-The Top Level Object-Oriented Framework (TLOOF) Approach. In International Conference on Conceptual Modeling. Springer, 1--15.
[24]
Bastien Sultan, Ludovic Apvrille, Philippe Jaillon, and Sophie Coudert. 2023. W-Sec: A Model-Based Formal Method for Assessing the Impacts of Security Countermeasures. In Model-Driven Engineering and Software Development, Luís Ferreira Pires, Slimane Hammoudi, and Edwin Seidewitz (Eds.). Springer Nature Switzerland, Cham, 203--229.
[25]
Bastien Sultan, Léon Frénot, Ludovic Apvrille, Philippe Jaillon, and Sophie Coudert. 2023. AMULET: a Mutation Language Enabling Automatic Enrichment of SysML Models. ACM Trans. Embed. Comput. Syst. (sep 2023). https://doi.org/10.1145/3624583
[26]
Damiano Torre, Yvan Labiche, and Marcela Genero. 2014. UML Consistency Rules: a Systematic Mapping Study. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering. 1--10.
[27]
Damiano Torre, Yvan Labiche, Marcela Genero, and Maged Elaasar. 2018. A Systematic Identification of Consistency Rules for UML Diagrams. Journal of Systems and Software 144 (2018), 121--142.
[28]
Carlos Mario Zapata, Guillermo González, and Alexander Gelbukh. 2007. A Rule-Based System for Assessing Consistency Between UML Models. In MICAI 2007: Advances in Artificial Intelligence: 6th Mexican International Conference on Artificial Intelligence, Aguascalientes, Mexico, November 4-10, 2007. Proceedings 6. Springer, 215--224.
Recommendations
A Model-driven Approach to Transform SysML Internal Block Diagrams to UML Activity Diagrams
ICEIS 2015: Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2The design of current software systems must take care not only of software but also of other elements, such
as processes, hardware and flows. For the software design counterpart, both for structural and dynamic views,
UML is currently widely applied. As ...
Formalization of UML diagrams and their consistency verification: A Z notation based approach
ISEC '08: Proceedings of the 1st India software engineering conferenceIn this paper, we have suggested a methodology for formalizing some of the commonly used UML diagrams that are used in different phases of software development in Z notation, establish their relationship and then represent the "formalized" diagrams ...
Transformation of SysML Structure Diagrams to VHDL-AMS
DMEMS '12: Proceedings of the 2012 Second Workshop on Design, Control and Software Implementation for Distributed MEMSIn this paper, we propose an approach to translate the Sys ML language to VHDL-AMS code. This approach is the first step to the generation of the VHDL-AMS code from the structural diagrams Sys ML. In this step, we address the Block Definition Diagram ...
Comments
Information & Contributors
Information
Published In
September 2024
311 pages
ISBN:9798400705045
DOI:10.1145/3640310
- General Chairs:
- Alexander Egyed,
- Manuel Wimmer,
- Program Chairs:
- Marsha Chechik,
- Benoit Combemale
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
- Johannes Kepler University, Linz, Austria
- SIGSOFT: ACM Special Interest Group on Software Engineering
- IEEE CS
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 September 2024
Check for updates
Badges
Artifacts Available / v1.1
Artifacts Evaluated & Functional / v1.1
Distinguished Paper
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
MODELS '24
Sponsor:
MODELS '24: ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems
September 22 - 27, 2024
Linz, Austria
Acceptance Rates
MODELS '24 Paper Acceptance Rate 26 of 124 submissions, 21%;
Overall Acceptance Rate 144 of 506 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 1,015Total Downloads
- Downloads (Last 12 months)1,015
- Downloads (Last 6 weeks)194
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in