Skip to main content
SpringerLink
Log in

Automated Testing of Web Applications Using Combinatorial Strategies

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Recently, testing techniques based on dynamic exploration, which try to automatically exercise every possible user interface element, have been extensively used to facilitate fully testing web applications. Most of such testing tools are however not effective in reaching dynamic pages induced by form interactions due to their emphasis on handling client-side scripting. In this paper, we present a combinatorial strategy to achieve a full form test and build an automated test model. We propose an algorithm called pairwise testing with constraints (PTC) to implement the strategy. Our PTC algorithm uses pairwise coverage and handles the issues of semantic constraints and illegal values. We have implemented a prototype tool ComjaxTest and conducted an empirical study on five web applications. Experimental results indicate that our PTC algorithm generates less form test cases while achieving a higher coverage of dynamic pages than the general pairwise testing algorithm. Additionally, our ComjaxTest generates a relatively complete test model and then detects more faults in a reasonable amount of time, as compared with other existing tools based on dynamic exploration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Mesbah A. Advances in testing JavaScript-based web applications. Advances in Computers, 2015, 97: 201-235.

  2. Mesbah A, Deursen A V, Lenselink S. Crawling AJAX-based web applications through dynamic analysis of user interface state changes. ACM Trans. the Web, 2012, 6(1):3:1-3:29.

  3. Mesbah A, Deursen A V, Roest D. Invariant-based automatic testing of modern web applications. IEEE Trans. Softw. Engin., 2012, 38(1): 35-53.

  4. Roest D, Mesbah A, Deursen A V. Regression testing AJAX applications: Coping with dynamism. In Proc. the 3rd Int. Conf. Software Testing, Verification, and Validation, April 2010, pp.127-136.

  5. Wang W, Lei Y, Sampath S et al. A combinatorial approach to building navigation graphs for dynamic Web applications. In Proc. the 25th Int. Conf. Software Maintenance, September 2009, pp.211-220.

  6. Kuhn D R, Reilly M J. An investigation of the applicability of design of experiments to software testing. In Proc. the 27th Annual NASA Goddard Software Engineering Workshop, December 2002, pp.91-95.

  7. Kuhn D R, Wallce D R, Gallo A M. Software fault interactions and implications for software testing. IEEE Trans. Softw. Eng., 2004, 30(6): 418-421.

  8. Nie C, Leung H. A survey of combinatorial testing. ACM Computing Surveys, 2011, 43(2): 11:1-11:29.

  9. Ostrand T J, Balcer M J. The category-partition method for specifying and generating fuctional tests. Communications of the ACM, 1988, 31(6): 676-686.

  10. Bryce R C, Colbourn C J. Prioritized interaction testing for pair-wise coverage with seeding and constraints. Information and Software Technology, 2006, 48(10): 960-970.

  11. Benedikt M, Freire J, Godefroid P. VeriWeb: Automatically testing dynamic Web sites. In Proc. the 11th Int. Conf. World Wide Web, May 2002, pp.654-668.

  12. Madhavan J, Ko D, Kot L et al. Google’s deep-web crawl. Proceedings of the VLDB Endowment, 2008, 1(2): 1241-1252.

  13. Cai R, Yang J M, Lai W et al. iRobot: An intelligent crawler for web forums. In Proc. the 17th Int. Conf. World Wide Web, April 2008, pp.447-456.

  14. Ricca F, Tonella P. Analysis and testing of web applications. In Proc. the 23rd Int. Conf. Software Engineering, May 2001, pp.25-34.

  15. Fard A M, Mesbah A. Feedback-directed exploration of web applications to derive test models. In Proc. the 24th Int. Symp. Software Reliability Engineering, November 2013, pp.278-287.

  16. MirzaAghaei M, Mesbah A. DOM-based test adequacy criteria for web applications. In Proc. Int. Symp. Software Testing and Analysis, July 2014, pp.71-81.

  17. Zou Y, Chen Z, Zheng Y et al. Virtual DOM coverage for effective testing of dynamic web application. In Proc. Int. Symp. Software Testing and Analysis, July 2014, pp.60-70.

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Southeast University, Nanjing, 211189, China

    Xiao-Fang Qi, Jun-Qiang Mao & Peng Wang

  2. Key Laboratory of Computer Network and Information Integration, Ministry of Education, Nanjing, 211189, China

    Xiao-Fang Qi

  3. School of Computer Science and Technology, Nanjing University of Posts and Telecommunications, Nanjing, 210023, China

    Zi-Yuan Wang

Authors
  1. Xiao-Fang Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zi-Yuan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun-Qiang Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiao-Fang Qi.

Additional information

This work is supported by the National Natural Science Foundation of China under Grant Nos. 61472076, 61472077, and 61300054.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qi, XF., Wang, ZY., Mao, JQ. et al. Automated Testing of Web Applications Using Combinatorial Strategies. J. Comput. Sci. Technol. 32, 199–210 (2017). https://doi.org/10.1007/s11390-017-1699-x

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-017-1699-x

Keywords

Search

Navigation