Skip to main content

A Resource-Aware Model-Based Framework for Load Testing of WS-BPEL Compositions

  • Conference paper
  • First Online:
Enterprise Information Systems (ICEIS 2018)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 363))

Included in the following conference series:

Abstract

Nowadays, Web services compositions are playing a major role in the implementation of different types of distributed architectures. Such applications usually provide services to hundreds of users simultaneously. Load Testing is considered as an important type of testing for Web services compositions, as such applications require concurrent access by many users simultaneously. In this context, load testing for these types of applications seems an important task in order to discover problems under high loads. For this goal, we propose a model-based resource aware test architecture aiming to study the behavior of WS-BPEL compositions taking into account load conditions. The main contribution of this work consists of (a) adopting the timed automata formalism to model the system under test and to generate digital-clock test suites (b) identifying the best node for hosting each tester instance, then (c) running load tests and recording performance data and finally (d) analyzing the obtained logs in order to detect problems under load. Our approach is illustrated by means of a case study from the healthcare domain.

This article is an extended version of our paperĀ [19] presented in ICEIS 2018.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Organization for the Advancement of Structured Information Standards.

  2. 2.

    Central Processing Unit.

  3. 3.

    Virtual Machines.

  4. 4.

    More machines may be considered as load generators in order to distribute the load more efficiently.

  5. 5.

    http://www.gecode.org.

  6. 6.

    http://www-03.ibm.com/software/products/fr/ibmilogcpleoptistud.

  7. 7.

    http://www.oracle.com/technetwork/middleware/bpel/.

References

  1. Alur, R., Dill, D.: A theory of timed automata. Theor. Comput. Sci. 126, 183ā€“235 (1994)

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  2. Bai, X., Dai, G., Xu, D., Tsai, W.: A multi-agent based framework for collaborative testing on web services. In: Proceedings of the 4th IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the 2nd International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA 2006), pp. 205ā€“210 (2006)

    Google ScholarĀ 

  3. Barreto, C., et al.: Web Services Business Process Execution Language Version 2.0 Primer. OASIS, May 2007

    Google ScholarĀ 

  4. Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Co., New York (1990)

    MATHĀ  Google ScholarĀ 

  5. Blom, J., Hessel, A., Jonsson, B., Pettersson, P.: Specifying and generating test cases using observer automata. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 125ā€“139. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31848-4_9

    ChapterĀ  Google ScholarĀ 

  6. Bornot, S., Sifakis, J., Tripakis, S.: Modeling urgency in timed systems. In: de Roever, W.-P., Langmaack, H., Pnueli, A. (eds.) COMPOS 1997. LNCS, vol. 1536, pp. 103ā€“129. Springer, Heidelberg (1998). https://doi.org/10.1007/3-540-49213-5_5

    ChapterĀ  Google ScholarĀ 

  7. Garousi, V., Briand, L.C., Labiche, Y.: Traffic-aware stress testing of distributed systems based on UML models. In: Proceedings of ICSE 2006, Shanghai, China, 20ā€“28 May 2006, pp. 391ā€“400. ACM (2006)

    Google ScholarĀ 

  8. Grosso, C.D., Antoniol, G., Penta, M.D., Galinier, P., Merlo, E.: Improving network applications security: a new heuristic to generate stress testing data. In: Proceedings of GECCO 2005, Washington DC, USA, 25ā€“29 June 2005, pp. 1037ā€“1043. ACM (2005)

    Google ScholarĀ 

  9. Hessel, A., Larsen, K.G., Nielsen, B., Pettersson, P., Skou, A.: Time-optimal real-time test case generation using Uppaal. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 114ā€“130. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24617-6_9

    ChapterĀ  Google ScholarĀ 

  10. James, H.H., Douglas, C.S., James, R.E., Aniruddha, S.G.: Tools for continuously evaluating distributed system qualities. IEEE Softw. 27(4), 65ā€“71 (2010)

    ArticleĀ  Google ScholarĀ 

  11. Jansen, K.: Parametrized approximation scheme for the multiple knapsack problem. In: Proceedings of the 20th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 2009), pp. 665ā€“674 (2009)

    Google ScholarĀ 

  12. Jiang, Z.M.: Automated analysis of load testing results. In: Proceedings of ISSTA 2010, Trento, Italy, 12ā€“16 July 2010, pp. 143ā€“146. ACM (2010)

    Google ScholarĀ 

  13. Jiang, Z.M., Hassan, A.E., Hamann, G., Flora, P.: Automatic identification of load testing problems. In: Proceedings of ICSM 2008, Beijing, China, 28 Septemberā€“4 October 2008, pp. 307ā€“316. IEEE (2008)

    Google ScholarĀ 

  14. Jussien, N., Rochart, G., Lorca, X.: Choco: an open source Java constraint programming library. In: Proceeding of the Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP 2008), pp. 1ā€“10 (2008)

    Google ScholarĀ 

  15. Krichen, M., Tripakis, S.: Conformance testing for real-time systems. Form. Methods Syst. Des. 34(3), 238ā€“304 (2009)

    ArticleĀ  Google ScholarĀ 

  16. Krizanic, J., Grguric, A., Mosmondor, M., Lazarevski, P.: Load testing and performance monitoring tools in use with ajax based web applications. In: 33rd International Convention on Information and Communication Technology, Electronics and Microelectronics, Opatija, Croatia, 24ā€“28 May 2010, pp. 428ā€“434. IEEE (2010)

    Google ScholarĀ 

  17. Lahami, M., Krichen, M., Bouchakwa, M., Jmaiel, M.: Using knapsack problem model to design a resource aware test architecture for adaptable and distributed systems. In: Nielsen, B., Weise, C. (eds.) ICTSS 2012. LNCS, vol. 7641, pp. 103ā€“118. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34691-0_9

    ChapterĀ  Google ScholarĀ 

  18. MaĆ¢lej, A.J., Krichen, M.: Study on the limitations of WS-BPEL compositions under load conditions. Comput. J. 58(3), 385ā€“402 (2015). https://doi.org/10.1093/comjnl/bxu140

    ArticleĀ  Google ScholarĀ 

  19. MaĆ¢lej, A.J., Lahami, M., Krichen, M., JmaĆÆel, M.: Distributed and resource-aware load testing of WS-BPEL compositions. In: Proceedings of the 20th International Conference on Enterprise Information Systems, ICEIS 2018, Funchal, Madeira, Portugal, 21ā€“24 March 2018, vol. 2, pp. 29ā€“38 (2018). https://doi.org/10.5220/0006693400290038

  20. Merdes, M., Malaka, R., Suliman, D., Paech, B., Brenner, D., Atkinson, C.: Ubiquitous RATs: how resource-aware run-time tests can improve ubiquitous software systems. In: Proceedings of the 6th International Workshop on Software Engineering and Middleware (SEM 2006), pp. 55ā€“62 (2006)

    Google ScholarĀ 

  21. Mikucionis, M., Larsen, K.G., Nielsen, B.: T-UPPAAL: online model-based testing of real-time systems. In: Proceedings of ASE 2004, Linz, Austria, 20ā€“25 September 2004, pp. 396ā€“397. IEEE Computer Society (2004)

    Google ScholarĀ 

  22. Murphy, C., Kaiser, G., Vo, I., Chu, M.: Quality assurance of software applications using the in vivo testing approach. In: Proceedings of the 2nd International Conference on Software Testing Verification and Validation (ICST 2009), pp. 111ā€“120 (2009)

    Google ScholarĀ 

  23. Myers, G.: The Art of Software Testing. Wiley, Hoboken (1979)

    Google ScholarĀ 

  24. Nielsen, B., Skou, A.: Automated test generation from timed automata. In: Margaria, T., Yi, W. (eds.) TACAS 2001. LNCS, vol. 2031, pp. 343ā€“357. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-45319-9_24

    ChapterĀ  Google ScholarĀ 

  25. Sifakis, J., Yovine, S.: Compositional specification of timed systems. In: Puech, C., Reischuk, R. (eds.) STACS 1996. LNCS, vol. 1046, pp. 345ā€“359. Springer, Heidelberg (1996). https://doi.org/10.1007/3-540-60922-9_29

    ChapterĀ  Google ScholarĀ 

  26. Springintveld, J., Vaandrager, F., Dā€™Argenio, P.: Testing timed automata. Theor. Comput. Sci. 254, 225ā€“257 (2001)

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  27. Tretmans, J.: Testing concurrent systems: a formal approach. In: Baeten, J.C.M., Mauw, S. (eds.) CONCUR 1999. LNCS, vol. 1664, pp. 46ā€“65. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48320-9_6

    ChapterĀ  Google ScholarĀ 

  28. Tripakis, S.: Fault diagnosis for timed automata. In: Damm, W., Olderog, E.-R. (eds.) FTRTFT 2002. LNCS, vol. 2469, pp. 205ā€“221. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45739-9_14

    ChapterĀ  MATHĀ  Google ScholarĀ 

  29. Yang, C.D., Pollock, L.L.: Towards a structural load testing tool. SIGSOFT Softw. Eng. Notes 21(3), 201ā€“208 (1996). https://doi.org/10.1145/226295.226318

    ArticleĀ  Google ScholarĀ 

  30. Zhang, J., Cheung, S.C.: Automated test case generation for the stress testing of multimedia systems. Softw. Pract. Exper. 32(15), 1411ā€“1435 (2002)

    ArticleĀ  Google ScholarĀ 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Moez Krichen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Krichen, M., MaĆ¢lej, A.J., Lahami, M., Jmaiel, M. (2019). A Resource-Aware Model-Based Framework for Load Testing of WS-BPEL Compositions. In: Hammoudi, S., Śmiałek, M., Camp, O., Filipe, J. (eds) Enterprise Information Systems. ICEIS 2018. Lecture Notes in Business Information Processing, vol 363. Springer, Cham. https://doi.org/10.1007/978-3-030-26169-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26169-6_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26168-9

  • Online ISBN: 978-3-030-26169-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics