Abstract
Model-Based Testing (mbt) has grown from testing infamous coffee machines to complex industrial size systems with many interfaces and parallel message exchanges.
Over the last decade Axini has developed a state-of-the-art platform, which can be used to model, analyze and test (very) large systems. We have successfully applied our platform to several medium to large applications in the finance and high-tech industry.
While modeling and testing such systems, we stumbled upon quality, management and engineering challenges to cope with the complexity of the whole mbt trajectory. We have developed several engineering guidelines to control both our modeling and testing trajectories.
Moreover, over the last few years, we have witnessed that model based working has gotten more acceptance within the industry. For mbt we see a shift of focus from testing to modeling. Originally, mbt would be applied when the development of the System Under Test was completely finished. Currently, we start the modeling during the analysis and design phase of the system. We have adapted our engineering methodology and guidelines accordingly.
We share our lessons learned and provide valuable insights for modeling and test engineers involved in model based testing and/or development.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The term ‘tracer bullet’ is a familiar term in software engineering [18] and is borrowed from flammable ammunition that gunners use to plot the trajectory of their shots.
References
Beck, K.: Extreme Programming Explained: Embrace Change. Addison-Wesley (1999)
Boehm, B.W.: Software engineering. IEEE Trans. Comput. 25(12), 1226–1241 (1976)
Bolognesi, T., Brinksma, E.: Introduction to the ISO specification language LOTOS. Comput. Netw. 14, 25–59 (1987)
Brinksma, E., Alderden, R., Langerak, R., van de Lagemaat, J., Tretmans, J.: A formal approach to conformance testing. In: de Meer, J., Mackert, L., Effelsberg, W. (eds.) Proceedings of the IFIP TC 6 Second International Workshop on Protocol Test Systems, Berlin, FRG, 3–6 October 1989, North-Holland. Also: Memorandum INF-89-45, University of Twente, The Netherlands, pp. 349–363 (1990)
Böhme, M., Paul, S.: A probabilistic analysis of the efficiency of automated software testing. IEEE Trans. Software Eng. 42(4), 345–360 (2016)
Dalal, S.R., et al.: Model-based testing in practice. In: Boehm, B.W. Garlan, D., Kramer, J. (eds.) Proceedings of the 1999 International Conference on Software Engineering, ICSE 99, Los Angeles, CA, USA, 16–22 May 1999, pp. 285–294. ACM (1999)
Elmendorf, W.R.: Automated design of program test libraries. Technical report TR 00.2089, IBM (1970)
Frantzen, L., Tretmans, J., Willemse, T.A.C.: Test generation based on symbolic specifications. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 1–15. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31848-4_1
Garousi, V., Keles, A.B., Balaman, Y., Güler, Z.Ö., Arcuri, A.: Model-based testing in practice: an experience report from the web applications domain. J. Syst. Softw. 180, 111032 (2021)
Holzmann, G.J.: The Spin Model Checker - Primer and Reference Manual. Addison-Wesley, Boston, USA (2003)
Li, W., Le Gall, F., Spaseski, N.: A survey on model-based testing tools for test case generation. In: Itsykson, V., Scedrov, A., Zakharov, V. (eds.) TMPA 2017. CCIS, vol. 779, pp. 77–89. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-71734-0_7
Matsumoto, Y.: Ruby in a Nutshell. O’Reilly (2001)
Neto, A.C., Subramanyan, R., Vieira, M., Travassos, G.: A survey on model-based testing approaches: a systematic review. In: Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies (WEASELTech 2007), pp. 31–36 (2007)
Petrenko, A., da Silva Simão, A., Maldonado, J.C.: Model-based testing of software and systems: recent advances and challenges. Int. J. Softw. Tools Technol. Transf. 14(4), 383–386 (2012)
Ruys, T.C.: Introduction to Model Based Testing and the Axini Modeling Language. Axini B.V., October 2021
Ruys, T.C., Brinksma, E.: Managing the Verification Trajectory. Int. J. Softw. Tools Technol. Transf. (STTT) 4(2), 246–259 (2003)
Schmaltz, J., Tretmans, J.: On conformance testing for timed systems. In: Cassez, F., Jard, C. (eds.) FORMATS 2008. LNCS, vol. 5215, pp. 250–264. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85778-5_18
Thomas, D., Hunt, A.: The Pragmatic Programmer (20th Anniversary Edition). Addison-Wesley (2020)
Tretmans, J.: A formal approach to conformance testing. In: Rafiq, O. (ed.) Protocol Test Systems, VI, Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test Systems, Pau, France, 28–30 September 1993, vol. C-19. IFIP Transactions, pp. 257–276. North-Holland (1993)
Tretmans, J.: Model based testing with labelled transition systems. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) Formal Methods and Testing. LNCS, vol. 4949, pp. 1–38. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78917-8_1
Utting, M., Legeaard, B.: Practical Model-Based Testing: a Tools approach. Elsevier (2010)
von Styp, S., Bohnenkamp, H., Schmaltz, J.: A conformance testing relation for symbolic timed automata. In: Chatterjee, K., Henzinger, T.A. (eds.) FORMATS 2010. LNCS, vol. 6246, pp. 243–255. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15297-9_19
Vos, T.E., van Vugt-Hage, N.: Software Testing - Workbook for O/U course ‘Software Testen’, cursuscode IB3202. Open University, Heerlen, The Netherlands (2019)
Axini. https://www.axini.com
Bits &Chips. Model-based testing in safety-critical Scaled Agile. https://bits-chips.nl/artikel/model-based-testing-in-safety-critical-scaled-agile
Acknowledgments
amp is already in development for more than a decade. Many current and former employees of Axini have worked on our toolset, and made it possible to apply mbt to industrial size systems. The internal discussions on structuring and standardizing the mbt trajectory were the basis for this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Ruys, T.C., van der Bijl, M. (2025). Effective Model-Based Testing. In: Jansen, N., et al. Principles of Verification: Cycling the Probabilistic Landscape . Lecture Notes in Computer Science, vol 15262. Springer, Cham. https://doi.org/10.1007/978-3-031-75778-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-75778-5_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-75777-8
Online ISBN: 978-3-031-75778-5
eBook Packages: Computer ScienceComputer Science (R0)