Skip to main content

Abstract

Current software development processes in the industry are designed to respond to rapid modification or changes in software features. Delta testing is a technique used to check that the identified changes are deliberate and neither compromise existing functionality nor result in introducing new defects. This paper proposes a technique for delta testing at the Graphical User Interface (GUI) level. We employ scriptless testing and state-model inference to automatically detect and visualize GUI changes between different versions of the same application. Our proposed offline change detection algorithm compares two existing GUI state models to detect changes. We present a proof of concept experiment with the open-source application Notepad++, which allows automatic inference and highlights GUI changes. The results show that our technique is a valuable amplification of scriptless testing tools for delta testing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://notepad-plus-plus.org/.

  2. 2.

    https://github.com/notepad-plus-plus/notepad-plus-plus/wiki/Changes.

  3. 3.

    https://github.com/TESTARtool/ChangeDetection.NET.

  4. 4.

    https://doi.org/10.5281/zenodo.7762904.

References

  1. Al-Saqqa, S., Sawalha, S., AbdelNabi, H.: Agile software development: methodologies and trends. Int. J. Inter. Mob. Technol. 14(11) (2020)

    Google Scholar 

  2. Andrews, K., Wohlfahrt, M., Wurzinger, G.: Visual graph comparison. In: 13th International Conference Information Visualisation, pp. 62–67. IEEE (2009)

    Google Scholar 

  3. Chahim, H., Duran, M., Vos, T.E.J., Aho, P., Condori Fernandez, N.: Scriptless testing at the GUI level in an industrial setting. In: Dalpiaz, F., Zdravkovic, J., Loucopoulos, P. (eds.) RCIS 2020. LNBIP, vol. 385, pp. 267–284. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50316-1_16

    Chapter  Google Scholar 

  4. Chang, N., Wang, L., Pei, Y., Mondal, S.K., Li, X.: Change-based test script maintenance for android apps. In: IEEE International Conference on Software Quality, Reliability and Security (QRS), pp. 215–225. IEEE (2018)

    Google Scholar 

  5. de Gier, F., Kager, D., de Gouw, S., Vos, E.T.: Offline oracles for accessibility evaluation with the Testar tool. In: 13th RCIS, pp. 1–12. IEEE (2019)

    Google Scholar 

  6. Gokarna, M., Singh, R.: DevOps: a historical review and future works. In: ICCCIS, pp. 366–371. IEEE (2021)

    Google Scholar 

  7. Gu, T., et al.: Practical GUI testing of android applications via model abstraction and refinement. In: 41st ICSE, pp. 269–280. IEEE/ACM (2019)

    Google Scholar 

  8. Inc., W.T.: Visualping: website change detection, monitoring and alerts (2017–2022). https://visualping.io/. Accessed 16 Feb 2023

  9. Kausar, M.A., Dhaka, V., Singh, S.K.: Web crawler: a review. Int. J. Comput. Appl. 63(2), 31–36 (2013)

    Google Scholar 

  10. Li, X., et al.: Atom: automatic maintenance of GUI test scripts for evolving mobile applications. In: 10th ICST, pp. 161–171. IEEE (2017)

    Google Scholar 

  11. Mallawaarachchi, V., Meegahapola, L., Madhushanka, R., Heshan, E., Meedeniya, D., Jayarathna, S.: Change detection and notification of web pages: a survey. ACM Comput. Surv. (CSUR) 53(1), 1–35 (2020)

    Article  Google Scholar 

  12. Mariani, L., Pezze, M., Riganelli, O., Santoro, M.: Autoblacktest: automatic black-box testing of interactive applications. In: 5th ICST, pp. 81–90. IEEE (2012)

    Google Scholar 

  13. Mariani, L., Pezzè, M., Zuddas, D.: Augusto: exploiting popular functionalities for the generation of semantic GUI tests with oracles. In: ICSE, pp. 280–290 (2018)

    Google Scholar 

  14. Mulders, A., Rodriguez-Valdes, O., Pastor Ricós, F., Aho, P., Marín, B., Vos, T.E.J.: State model inference through the GUI using run-time test generation. In: Guizzardi, R., Ralyte, J., Franch, X. (eds.) Research Challenges in Information Science. RCIS 2022. Lecture Notes in Business Information Processing, vol. 446, pp. 546–563. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-05760-1_32

  15. Ngo, C.D., Pastore, F., Briand, L.: Automated, cost-effective, and update-driven app testing. ACM TOSEM 31(4), 1–51 (2022)

    Article  Google Scholar 

  16. Nguyen, B.N., Robbins, B., Banerjee, I., Memon, A.: Guitar: an innovative tool for automated testing of GUI-driven software. ASE 21(1), 65–105 (2014)

    Google Scholar 

  17. Pantiuchina, J., Mondini, M., Khanna, D., Wang, X., Abrahamsson, P.: Are software startups applying agile practices? The state of the practice from a large survey. In: Baumeister, H., Lichter, H., Riebisch, M. (eds.) XP 2017. LNBIP, vol. 283, pp. 167–183. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-57633-6_11

    Chapter  Google Scholar 

  18. Ricós, F.P., Aho, P., Vos, T., Boigues, I.T., Blasco, E.C., Martínez, H.M.: Deploying TESTAR to enable remote testing in an industrial CI pipeline: a case-based evaluation. In: Margaria, T., Steffen, B. (eds.) ISoLA 2020. LNCS, vol. 12476, pp. 543–557. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-61362-4_31

    Chapter  Google Scholar 

  19. Peng, C., Rajan, A., Cai, T.: Cat: Change-focused android GUI testing. In: ICSME, pp. 460–470. IEEE (2021)

    Google Scholar 

  20. Salihu, I.A., Ibrahim, R., Ahmed, B.S., Zamli, K.Z., Usman, A.: AMOGA: a static-dynamic model generation strategy for mobile apps testing. IEEE Access 7, 17158–17173 (2019)

    Article  Google Scholar 

  21. s.r.o., W.: Wachete: monitor web changes (2014–2022). https://www.wachete.com/. Accessed 16 Feb 2023

  22. Vos, T.E.J., Aho, P., Pastor Ricos, F., Rodriguez Valdes, O., Mulders, A.: TESTAR-scriptless testing through graphical user interface. STVR 31(3), e1771 (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fernando Pastor Ricós .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ricós, F.P., Neeft, R., Marín, B., Vos, T.E.J., Aho, P. (2023). Using GUI Change Detection for Delta Testing. In: Nurcan, S., Opdahl, A.L., Mouratidis, H., Tsohou, A. (eds) Research Challenges in Information Science: Information Science and the Connected World. RCIS 2023. Lecture Notes in Business Information Processing, vol 476. Springer, Cham. https://doi.org/10.1007/978-3-031-33080-3_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-33080-3_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-33079-7

  • Online ISBN: 978-3-031-33080-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics