Abstract
Nowadays, Web services compositions are playing a major role in the implementation of different types of distributed architectures. Such applications usually provide services to hundreds of users simultaneously. Load Testing is considered as an important type of testing for Web services compositions, as such applications require concurrent access by many users simultaneously. In this context, load testing for these types of applications seems an important task in order to discover problems under high loads. For this goal, we propose a model-based resource aware test architecture aiming to study the behavior of WS-BPEL compositions taking into account load conditions. The main contribution of this work consists of (a) adopting the timed automata formalism to model the system under test and to generate digital-clock test suites (b) identifying the best node for hosting each tester instance, then (c) running load tests and recording performance data and finally (d) analyzing the obtained logs in order to detect problems under load. Our approach is illustrated by means of a case study from the healthcare domain.
This article is an extended version of our paper [19] presented in ICEIS 2018.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Organization for the Advancement of Structured Information Standards.
- 2.
Central Processing Unit.
- 3.
Virtual Machines.
- 4.
More machines may be considered as load generators in order to distribute the load more efficiently.
- 5.
- 6.
- 7.
References
Alur, R., Dill, D.: A theory of timed automata. Theor. Comput. Sci. 126, 183–235 (1994)
Bai, X., Dai, G., Xu, D., Tsai, W.: A multi-agent based framework for collaborative testing on web services. In: Proceedings of the 4th IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the 2nd International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA 2006), pp. 205–210 (2006)
Barreto, C., et al.: Web Services Business Process Execution Language Version 2.0 Primer. OASIS, May 2007
Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Co., New York (1990)
Blom, J., Hessel, A., Jonsson, B., Pettersson, P.: Specifying and generating test cases using observer automata. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 125–139. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31848-4_9
Bornot, S., Sifakis, J., Tripakis, S.: Modeling urgency in timed systems. In: de Roever, W.-P., Langmaack, H., Pnueli, A. (eds.) COMPOS 1997. LNCS, vol. 1536, pp. 103–129. Springer, Heidelberg (1998). https://doi.org/10.1007/3-540-49213-5_5
Garousi, V., Briand, L.C., Labiche, Y.: Traffic-aware stress testing of distributed systems based on UML models. In: Proceedings of ICSE 2006, Shanghai, China, 20–28 May 2006, pp. 391–400. ACM (2006)
Grosso, C.D., Antoniol, G., Penta, M.D., Galinier, P., Merlo, E.: Improving network applications security: a new heuristic to generate stress testing data. In: Proceedings of GECCO 2005, Washington DC, USA, 25–29 June 2005, pp. 1037–1043. ACM (2005)
Hessel, A., Larsen, K.G., Nielsen, B., Pettersson, P., Skou, A.: Time-optimal real-time test case generation using Uppaal. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 114–130. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24617-6_9
James, H.H., Douglas, C.S., James, R.E., Aniruddha, S.G.: Tools for continuously evaluating distributed system qualities. IEEE Softw. 27(4), 65–71 (2010)
Jansen, K.: Parametrized approximation scheme for the multiple knapsack problem. In: Proceedings of the 20th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 2009), pp. 665–674 (2009)
Jiang, Z.M.: Automated analysis of load testing results. In: Proceedings of ISSTA 2010, Trento, Italy, 12–16 July 2010, pp. 143–146. ACM (2010)
Jiang, Z.M., Hassan, A.E., Hamann, G., Flora, P.: Automatic identification of load testing problems. In: Proceedings of ICSM 2008, Beijing, China, 28 September–4 October 2008, pp. 307–316. IEEE (2008)
Jussien, N., Rochart, G., Lorca, X.: Choco: an open source Java constraint programming library. In: Proceeding of the Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP 2008), pp. 1–10 (2008)
Krichen, M., Tripakis, S.: Conformance testing for real-time systems. Form. Methods Syst. Des. 34(3), 238–304 (2009)
Krizanic, J., Grguric, A., Mosmondor, M., Lazarevski, P.: Load testing and performance monitoring tools in use with ajax based web applications. In: 33rd International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia, 24–28 May 2010, pp. 428–434. IEEE (2010)
Lahami, M., Krichen, M., Bouchakwa, M., Jmaiel, M.: Using knapsack problem model to design a resource aware test architecture for adaptable and distributed systems. In: Nielsen, B., Weise, C. (eds.) ICTSS 2012. LNCS, vol. 7641, pp. 103–118. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34691-0_9
Maâlej, A.J., Krichen, M.: Study on the limitations of WS-BPEL compositions under load conditions. Comput. J. 58(3), 385–402 (2015). https://doi.org/10.1093/comjnl/bxu140
Maâlej, A.J., Lahami, M., Krichen, M., Jmaïel, M.: Distributed and resource-aware load testing of WS-BPEL compositions. In: Proceedings of the 20th International Conference on Enterprise Information Systems, ICEIS 2018, Funchal, Madeira, Portugal, 21–24 March 2018, vol. 2, pp. 29–38 (2018). https://doi.org/10.5220/0006693400290038
Merdes, M., Malaka, R., Suliman, D., Paech, B., Brenner, D., Atkinson, C.: Ubiquitous RATs: how resource-aware run-time tests can improve ubiquitous software systems. In: Proceedings of the 6th International Workshop on Software Engineering and Middleware (SEM 2006), pp. 55–62 (2006)
Mikucionis, M., Larsen, K.G., Nielsen, B.: T-UPPAAL: online model-based testing of real-time systems. In: Proceedings of ASE 2004, Linz, Austria, 20–25 September 2004, pp. 396–397. IEEE Computer Society (2004)
Murphy, C., Kaiser, G., Vo, I., Chu, M.: Quality assurance of software applications using the in vivo testing approach. In: Proceedings of the 2nd International Conference on Software Testing Verification and Validation (ICST 2009), pp. 111–120 (2009)
Myers, G.: The Art of Software Testing. Wiley, Hoboken (1979)
Nielsen, B., Skou, A.: Automated test generation from timed automata. In: Margaria, T., Yi, W. (eds.) TACAS 2001. LNCS, vol. 2031, pp. 343–357. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45319-9_24
Sifakis, J., Yovine, S.: Compositional specification of timed systems. In: Puech, C., Reischuk, R. (eds.) STACS 1996. LNCS, vol. 1046, pp. 345–359. Springer, Heidelberg (1996). https://doi.org/10.1007/3-540-60922-9_29
Springintveld, J., Vaandrager, F., D’Argenio, P.: Testing timed automata. Theor. Comput. Sci. 254, 225–257 (2001)
Tretmans, J.: Testing concurrent systems: a formal approach. In: Baeten, J.C.M., Mauw, S. (eds.) CONCUR 1999. LNCS, vol. 1664, pp. 46–65. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48320-9_6
Tripakis, S.: Fault diagnosis for timed automata. In: Damm, W., Olderog, E.-R. (eds.) FTRTFT 2002. LNCS, vol. 2469, pp. 205–221. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45739-9_14
Yang, C.D., Pollock, L.L.: Towards a structural load testing tool. SIGSOFT Softw. Eng. Notes 21(3), 201–208 (1996). https://doi.org/10.1145/226295.226318
Zhang, J., Cheung, S.C.: Automated test case generation for the stress testing of multimedia systems. Softw. Pract. Exper. 32(15), 1411–1435 (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Krichen, M., Maâlej, A.J., Lahami, M., Jmaiel, M. (2019). A Resource-Aware Model-Based Framework for Load Testing of WS-BPEL Compositions. In: Hammoudi, S., Śmiałek, M., Camp, O., Filipe, J. (eds) Enterprise Information Systems. ICEIS 2018. Lecture Notes in Business Information Processing, vol 363. Springer, Cham. https://doi.org/10.1007/978-3-030-26169-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-26169-6_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-26168-9
Online ISBN: 978-3-030-26169-6
eBook Packages: Computer ScienceComputer Science (R0)