Abstract
Nowadays, Web services compositions are playing a major role in the implementation of different types of distributed architectures. Such applications usually provide services to hundreds of users simultaneously. Load Testing is considered as an important type of testing for Web services compositions, as such applications require concurrent access by many users simultaneously. In this context, load testing for these types of applications seems an important task in order to discover problems under high loads. For this goal, we propose a model-based resource aware test architecture aiming to study the behavior of WS-BPEL compositions taking into account load conditions. The main contribution of this work consists of (a) adopting the timed automata formalism to model the system under test and to generate digital-clock test suites (b) identifying the best node for hosting each tester instance, then (c) running load tests and recording performance data and finally (d) analyzing the obtained logs in order to detect problems under load. Our approach is illustrated by means of a case study from the healthcare domain.
This article is an extended version of our paperĀ [19] presented in ICEIS 2018.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Organization for the Advancement of Structured Information Standards.
- 2.
Central Processing Unit.
- 3.
Virtual Machines.
- 4.
More machines may be considered as load generators in order to distribute the load more efficiently.
- 5.
- 6.
- 7.
References
Alur, R., Dill, D.: A theory of timed automata. Theor. Comput. Sci. 126, 183ā235 (1994)
Bai, X., Dai, G., Xu, D., Tsai, W.: A multi-agent based framework for collaborative testing on web services. In: Proceedings of the 4th IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the 2nd International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA 2006), pp. 205ā210 (2006)
Barreto, C., et al.: Web Services Business Process Execution Language Version 2.0 Primer. OASIS, May 2007
Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Co., New York (1990)
Blom, J., Hessel, A., Jonsson, B., Pettersson, P.: Specifying and generating test cases using observer automata. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 125ā139. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31848-4_9
Bornot, S., Sifakis, J., Tripakis, S.: Modeling urgency in timed systems. In: de Roever, W.-P., Langmaack, H., Pnueli, A. (eds.) COMPOS 1997. LNCS, vol. 1536, pp. 103ā129. Springer, Heidelberg (1998). https://doi.org/10.1007/3-540-49213-5_5
Garousi, V., Briand, L.C., Labiche, Y.: Traffic-aware stress testing of distributed systems based on UML models. In: Proceedings of ICSE 2006, Shanghai, China, 20ā28 May 2006, pp. 391ā400. ACM (2006)
Grosso, C.D., Antoniol, G., Penta, M.D., Galinier, P., Merlo, E.: Improving network applications security: a new heuristic to generate stress testing data. In: Proceedings of GECCO 2005, Washington DC, USA, 25ā29 June 2005, pp. 1037ā1043. ACM (2005)
Hessel, A., Larsen, K.G., Nielsen, B., Pettersson, P., Skou, A.: Time-optimal real-time test case generation using Uppaal. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 114ā130. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24617-6_9
James, H.H., Douglas, C.S., James, R.E., Aniruddha, S.G.: Tools for continuously evaluating distributed system qualities. IEEE Softw. 27(4), 65ā71 (2010)
Jansen, K.: Parametrized approximation scheme for the multiple knapsack problem. In: Proceedings of the 20th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 2009), pp. 665ā674 (2009)
Jiang, Z.M.: Automated analysis of load testing results. In: Proceedings of ISSTA 2010, Trento, Italy, 12ā16 July 2010, pp. 143ā146. ACM (2010)
Jiang, Z.M., Hassan, A.E., Hamann, G., Flora, P.: Automatic identification of load testing problems. In: Proceedings of ICSM 2008, Beijing, China, 28 Septemberā4 October 2008, pp. 307ā316. IEEE (2008)
Jussien, N., Rochart, G., Lorca, X.: Choco: an open source Java constraint programming library. In: Proceeding of the Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP 2008), pp. 1ā10 (2008)
Krichen, M., Tripakis, S.: Conformance testing for real-time systems. Form. Methods Syst. Des. 34(3), 238ā304 (2009)
Krizanic, J., Grguric, A., Mosmondor, M., Lazarevski, P.: Load testing and performance monitoring tools in use with ajax based web applications. In: 33rd International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia, 24ā28 May 2010, pp. 428ā434. IEEE (2010)
Lahami, M., Krichen, M., Bouchakwa, M., Jmaiel, M.: Using knapsack problem model to design a resource aware test architecture for adaptable and distributed systems. In: Nielsen, B., Weise, C. (eds.) ICTSS 2012. LNCS, vol. 7641, pp. 103ā118. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34691-0_9
MaĆ¢lej, A.J., Krichen, M.: Study on the limitations of WS-BPEL compositions under load conditions. Comput. J. 58(3), 385ā402 (2015). https://doi.org/10.1093/comjnl/bxu140
MaĆ¢lej, A.J., Lahami, M., Krichen, M., JmaĆÆel, M.: Distributed and resource-aware load testing of WS-BPEL compositions. In: Proceedings of the 20th International Conference on Enterprise Information Systems, ICEIS 2018, Funchal, Madeira, Portugal, 21ā24 March 2018, vol. 2, pp. 29ā38 (2018). https://doi.org/10.5220/0006693400290038
Merdes, M., Malaka, R., Suliman, D., Paech, B., Brenner, D., Atkinson, C.: Ubiquitous RATs: how resource-aware run-time tests can improve ubiquitous software systems. In: Proceedings of the 6th International Workshop on Software Engineering and Middleware (SEM 2006), pp. 55ā62 (2006)
Mikucionis, M., Larsen, K.G., Nielsen, B.: T-UPPAAL: online model-based testing of real-time systems. In: Proceedings of ASE 2004, Linz, Austria, 20ā25 September 2004, pp. 396ā397. IEEE Computer Society (2004)
Murphy, C., Kaiser, G., Vo, I., Chu, M.: Quality assurance of software applications using the in vivo testing approach. In: Proceedings of the 2nd International Conference on Software Testing Verification and Validation (ICST 2009), pp. 111ā120 (2009)
Myers, G.: The Art of Software Testing. Wiley, Hoboken (1979)
Nielsen, B., Skou, A.: Automated test generation from timed automata. In: Margaria, T., Yi, W. (eds.) TACAS 2001. LNCS, vol. 2031, pp. 343ā357. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45319-9_24
Sifakis, J., Yovine, S.: Compositional specification of timed systems. In: Puech, C., Reischuk, R. (eds.) STACS 1996. LNCS, vol. 1046, pp. 345ā359. Springer, Heidelberg (1996). https://doi.org/10.1007/3-540-60922-9_29
Springintveld, J., Vaandrager, F., DāArgenio, P.: Testing timed automata. Theor. Comput. Sci. 254, 225ā257 (2001)
Tretmans, J.: Testing concurrent systems: a formal approach. In: Baeten, J.C.M., Mauw, S. (eds.) CONCUR 1999. LNCS, vol. 1664, pp. 46ā65. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48320-9_6
Tripakis, S.: Fault diagnosis for timed automata. In: Damm, W., Olderog, E.-R. (eds.) FTRTFT 2002. LNCS, vol. 2469, pp. 205ā221. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45739-9_14
Yang, C.D., Pollock, L.L.: Towards a structural load testing tool. SIGSOFT Softw. Eng. Notes 21(3), 201ā208 (1996). https://doi.org/10.1145/226295.226318
Zhang, J., Cheung, S.C.: Automated test case generation for the stress testing of multimedia systems. Softw. Pract. Exper. 32(15), 1411ā1435 (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Krichen, M., MaĆ¢lej, A.J., Lahami, M., Jmaiel, M. (2019). A Resource-Aware Model-Based Framework for Load Testing of WS-BPEL Compositions. In: Hammoudi, S., ÅmiaÅek, M., Camp, O., Filipe, J. (eds) Enterprise Information Systems. ICEIS 2018. Lecture Notes in Business Information Processing, vol 363. Springer, Cham. https://doi.org/10.1007/978-3-030-26169-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-26169-6_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-26168-9
Online ISBN: 978-3-030-26169-6
eBook Packages: Computer ScienceComputer Science (R0)