Skip to main content
SpringerLink
Log in

On Persistent Implications of E2E Testing

  • Conference paper
  • First Online:
Enterprise Information Systems (ICEIS 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 455))

Included in the following conference series:

  • 524 Accesses

Abstract

An emerging paradigm of reactive systems architecture comes with important implications on software testing. Despite community interests in running effective end-to-end (E2E) tests on reactive systems, little work has considered the implications of tests that modify the database. We propose a framework to the group and orchestrate E2E tests based on data qualities across a series of parallel containerized application instances. The framework is designed to run completely independent tests in parallel while being mindful of resource costs. We present a conceptual version of the framework and discuss database implications for this type of software testing.

This material is based upon work supported by the National Science Foundation under Grant No. 1854049 and a grant from Red Hat Research; we also recognize CTU FEE support for this project.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://serenity-bdd.info/.

References

  1. Amazon Web Services: Practicing Continuous Integration and Continuous Delivery on AWS (2017). https://d0.awsstatic.com/whitepapers/DevOps/practicing-continuous-integration-continuous-delivery-on-AWS.pdf

  2. Amazon Web Services: Modern Application Development on AWS, p. 41 (2019). https://d1.awsstatic.com/whitepapers/modern-application-development-on-aws.pdf

  3. Amazon Web Services: Overview of Amazon Web Services - AWS Whitepaper (2021)

    Google Scholar 

  4. Ammann, P., Offutt, J.: Introduction to Software Testing, 2nd edn. Cambridge University Press, Cambridge (2017)

    Google Scholar 

  5. Augusto, C.: Efficient test execution in end to end testing: resource optimization in end to end testing through a smart resource characterization and orchestration. In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Companion Proceedings, pp. 152–154. ICSE 2020, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3377812.3382177

  6. Bertolino, A., Calabró, A., Angelis, G.D., Gallego, M., García, B., Gortázar, F.: When the testing gets tough, the tough get ElasTest. In: 2018 IEEE/ACM 40th International Conference on Software Engineering: Companion (ICSE-Companion), pp. 17–20 (2018). iSSN: 2574–1934

    Google Scholar 

  7. Beswick, J.: New for AWS lambda - predictable start-up times with provisioned concurrency (2019). https://aws.amazon.com/blogs/compute/new-for-aws-lambda-predictable-start-up-times-with-provisioned-concurrency/

  8. Bonér, J., Farley, D., Kuhn, R., Thompson, M.: The reactive manifesto (2014). https://www.reactivemanifesto.org/

  9. Bures, M.: PCTgen: automated generation of test cases for application workflows. In: Rocha, A., Correia, A.M., Costanzo, S., Reis, L.P. (eds.) New Contributions in Information Systems and Technologies. AISC, vol. 353, pp. 789–794. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16486-1_78

    Chapter  Google Scholar 

  10. Bures, M., Cerny, T., Klima, M.: Prioritized process test: more efficiency in testing of business processes and workflows. In: Kim, K., Joukov, N. (eds.) ICISA 2017. LNEE, vol. 424, pp. 585–593. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-4154-9_67

    Chapter  Google Scholar 

  11. Docker Inc.: Compose file version 3 reference (2019). https://docs.docker.com/compose/compose-file/

  12. Donahoo, M.J., et al.: ICPC developer documentation (2021). https://icpc.global

  13. Garcia, B., Gallego, M., Santos, C., Jimenez, E., Leal, K., Fernanez, L.: Extending webdriver: a cloud approach. In: 2018 11th International Conference on the Quality of Information and Communications Technology (QUATIC), pp. 143–146. IEEE, Coimbra (2018). https://doi.org/10.1109/QUATIC.2018.00029. https://ieeexplore.ieee.org/document/8590182/

  14. Gligoric, M., Eloussi, L., Marinov, D.: Ekstazi: lightweight test selection. In: Proceedings of the 37th International Conference on Software Engineering, vol. 2, pp. 713–716. ICSE 2015, IEEE Press, Florence, Italy (2015)

    Google Scholar 

  15. Gommeringer, M., et al.: DbUnit (2012). http://www.dbunit.org/

  16. Gortázar, F., Gallego, M., García, B., Carella, G.A., Pauls, M., Gheorghe-Pop, I.: Elastest - an open source project for testing distributed applications with failure injection. In: 2017 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN), pp. 1–2 (2017). https://doi.org/10.1109/NFV-SDN.2017.8169851

  17. Huggins, J., et al.: Selenium - web browser automation (2021). https://docs.seleniumhq.org/

  18. Johnson, T., Lindell, C.: Docker image selenium test : a proof of concept for automating testing (2020). http://urn.kb.se/resolve?urn=urn:nbn:se:hh:diva-43032

  19. JUnit: JUnit 5 (2021). https://junit.org/junit5/

  20. Kawaguchi, K., et al.: Jenkins (2021). https://www.jenkins.io/index.html

  21. Leotta, M., Clerissi, D., Ricca, F., Spadaro, C.: Improving test suites maintainability with the page object pattern: an industrial case study. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops, pp. 108–113 (2013). https://doi.org/10.1109/ICSTW.2013.19

  22. Marcano, A., Palmer, A., Molak, J., Smart, J.F.: Page objects refactored: Solid steps to the screenplay/journey pattern - dzone devops (Feb 2016), https://dzone.com/articles/page-objects-refactored-solid-steps-to-the-screenp

  23. Merkel, D., et al.: Docker: lightweight linux containers for consistent development and deployment. Linux J. 2014(239), 2 (2014)

    Google Scholar 

  24. Schrammel, P., Melham, T., Kroening, D.: Chaining test cases for reactive system testing. In: Yenigün, H., Yilmaz, C., Ulrich, A. (eds.) ICTSS 2013. LNCS, vol. 8254, pp. 133–148. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41707-8_9

    Chapter  Google Scholar 

  25. Selenium: grid : documentation for selenium (2021). https://www.selenium.dev/documentation/en/grid/

  26. Stocco, A., Leotta, M., Ricca, F., Tonella, P.: APOGEN: automatic page object generator for web testing. Softw. Qual. J. 25(3), 1007–1039 (2016). https://doi.org/10.1007/s11219-016-9331-9

    Article  Google Scholar 

  27. Testim: testcraft - codeless test automation (2021). https://www.testcraft.io/

  28. The international collegiate programming contest: MyICPC (2021). https://my.icpc.global

  29. The Kubernetes authors: Kubernetes (2021). https://kubernetes.io/

  30. Tsai, W.T., Bai, X., Paul, R., Shao, W., Agarwal, V.: End-to-end integration testing design. In: 25th Annual International Computer Software and Applications Conference. COMPSAC 2001, pp. 166–171 (2001). https://doi.org/10.1109/CMPSAC.2001.960613. iSSN: 0730-3157

  31. Vasic, M., Parvez, Z., Milicevic, A., Gligoric, M.: File-level vs. module-level regression test selection for .NET. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp. 848–853. ESEC/FSE 2017, Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3106237.3117763

  32. Wood., D., Cerny., T.: Database-conscious end-to-end testing for reactive systems using containerization. In: Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 2: ICEIS, pp. 377–383. INSTICC, SciTePress (2021). https://doi.org/10.5220/0010494403770383

  33. Bai, X., Tsai, W. T., Paul, R., Shen, T., Li, B.: Distributed end-to-end testing management. In: Proceedings Fifth IEEE International Enterprise Distributed Object Computing Conference, pp. 140–151 (2001). https://doi.org/10.1109/EDOC.2001.950430

  34. Yuniasri, D., Badriyah, T., Sa’adah, U.: A comparative analysis of quality page object and screenplay design pattern on web-based automation testing. In: 2020 International Conference on Electrical, Communication, and Computer Engineering (ICECCE), pp. 1–5 (2020). https://doi.org/10.1109/ICECCE49384.2020.9179470

Download references

Acknowledgments

This material is based upon work supported by the National Science Foundation under Grant No. 1854049 and a grant from Red Hat Research; we also recognize CTU FEE support for this project.

Author information

Authors and Affiliations

  1. Czech Technical University, FEE, Karlovo nam. 13, Prague 2, 12125, Czech Republic

    Karel Frajtak

  2. Baylor University, One Bear Place #97141, Waco, TX, 76798, USA

    Tomas Cerny

Authors
  1. Karel Frajtak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tomas Cerny
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tomas Cerny .

Editor information

Editors and Affiliations

  1. Polytechnic Institute of Setúbal/INSTICC, Setúbal, Portugal

    Joaquim Filipe

  2. Warsaw University of Technology, Warsaw, Poland

    Michał Śmiałek

  3. George Mason University, Fairfax, VA, USA

    Alexander Brodsky

  4. MODESTE/ESEO, Angers, France

    Slimane Hammoudi

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Frajtak, K., Cerny, T. (2022). On Persistent Implications of E2E Testing. In: Filipe, J., Śmiałek, M., Brodsky, A., Hammoudi, S. (eds) Enterprise Information Systems. ICEIS 2021. Lecture Notes in Business Information Processing, vol 455. Springer, Cham. https://doi.org/10.1007/978-3-031-08965-7_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-08965-7_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-08964-0

  • Online ISBN: 978-3-031-08965-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation